Interactive devices

ABSTRACT

An interactive assembly including at least one interactive surface element, at least a first region of the at least one interactive surface element having first user sensible functionality and at least a second region of the at least one interactive surface element having second functionality, different from the first user sensible functionality, input sensor functionality, including at least one input sensor located in propinquity to at least one of the at least one interactive surface element, operative to sense impingement of an electromagnetic radiation spot on at least one of the at least one first region and the at least one second region of the at least one interactive surface element and utilization functionality for employing outputs of the input sensor functionality in respect of impingement on either or both of the at least one first region and the at least one second region.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application is a continuation application of non-provisionalU.S. patent application Ser. No. 14/108,242, filed Dec. 16, 2013, whichis a divisional application of non-provisional U.S. patent applicationSer. No. 12/531,039, filed Jan. 15, 2010, now issued U.S. Pat. No.8,610,675, which is a National Phase application under 35 U.S.C. § 371of PCT Patent Application No. PCT/IL2008/000355, filed Mar. 13, 2008,which claims priority to U.S. Provisional Patent Application No.60/918,303, filed Mar. 14, 2007, PCT Application No. PCT/IL2007/000332,filed Mar. 14, 2007, and PCT Application No. PCT/IL2007/000433 filedApr. 1, 2007; the contents of the foregoing are hereby incorporated byreference.

TECHNICAL FIELD

The present disclosure relates to displays, interactive assemblies anduser interface functionalities.

BACKGROUND

The following published patent documents, the disclosures of which arehereby incorporated by reference, are believed to represent the currentstate of the art: Great Britain Patent Numbers: GB2299856 and GB2289756;European Patent Number: EP0572182;

PCT Patent Application Publication Numbers: WO 02/043045, WO 03/104965A2; WO 2005/094176 A3; WO 95/02801 and WO 2005/094176. U.S. Pat. Nos.6,404,416; 6,094,188; 6,081,255; 6,028,649; 5,926,168; 5,892,501;5,448,261; 5,227,985; 5,949,402; 5,959,617; 5,122,656; 5,506,605 and4,320,292; and

U.S. patent Publication Nos.: US 2001/0050672, 2001/0031067 and2005/0156914.

SUMMARY

The present disclosure seeks to provide improved assemblies includingimproved user interfaces and user interface functionalities,particularly useful for displays, such as those employed with computers,televisions, personal communicators and other mobile devices.

There is thus provided in accordance with a preferred embodiment of thepresent disclosure an interactive assembly including at least oneinteractive surface element, at least a first region of the at least oneinteractive surface element having first user sensible functionality andat least a second region of the at least one interactive surface elementhaving second functionality, different from the first user sensiblefunctionality, input sensor functionality, including at least one inputsensor located in propinquity to at least one of the at least oneinteractive surface element, operative to sense impingement of anelectromagnetic radiation spot on at least one of the at least one firstregion and the at least one second region of the at least oneinteractive surface element and utilization functionality for employingoutputs of the input sensor functionality in respect of impingement oneither or both of the at least one first region and the at least onesecond region. Preferably, the interactive assembly also includes atleast one IR illuminator for illuminating at least one object having atleast a predetermined degree of propinquity to the at least oneinteractive element. Additionally, the at least one illuminator alsofunctions as at least one backlighting illuminator associated with theat least one interactive element. Preferably, the at least oneilluminator is located in a plane coplanar with or parallel to the atleast one sensor. Additionally or alternatively, the at least oneilluminator is located generally in the same plane as at least onebacklighting illuminator associated with the at least one interactiveelement.

Preferably, the at least one sensor senses light reflected from the atleast one object. Additionally or alternatively, the at least one sensorsenses ambient light reflected from the at least one object.Alternatively or additionally, the at least one sensor senses IR lightreflected from the at least one object.

Preferably, the at least one object is at least one finger.Alternatively or additionally, the at least one object is at least onepointing device.

Preferably, the utilization functionality includes utilizationcircuitry. Additionally, the utilization circuitry provides chordingfunctionality. Additionally or alternatively, the utilization circuitryprovides functionality to distinguish at least between positions of theat least one object when touching and not touching the interactiveassembly. Preferably, the utilization circuitry provides functionalityto distinguish at least between directions of motion of the at least oneobject towards and away from the interactive assembly. Preferably, theutilization circuitry provides functionality to compute at least onecharacteristic of a trajectory of motion of the at least one objectgenerally parallel to the interactive surface element. Additionally, theat least one characteristic includes at least one of location,direction, velocity and change in direction.

Preferably, the utilization circuitry provides functionality for panningand scrolling. Additionally or alternatively, the utilization circuitryprovides functionality for one-handed zooming.

Preferably, the utilization circuitry provides functionality foremploying a sensed distinction between instances when the at least oneobject touches and does not touch the device. Additionally oralternatively, the utilization circuitry provides functionality formouse over and click. Alternatively or additionally, the utilizationcircuitry provides functionality for turning pages. Additionally oralternatively, the utilization circuitry provides functionality forgaming. Alternatively or additionally, the utilization circuitryprovides functionality utilizing differences in sensed relativepositions of a user's fingers. Preferably, the utilization circuitryprovides interactive television functionality. Additionally oralternatively, the utilization circuitry provides portable computerfunctionality.

Preferably, the at least one sensor includes at least one detectorelement arranged in a plane parallel to a viewing plane. Additionally oralternatively, the at least one sensor is coplanar with the viewingplane. Alternatively, the at least one detector element includes aplurality of detector elements arranged in a plane parallel to theviewing plane.

Preferably, the at least one sensor includes a detector assemblyarranged at least one edge of the interactive surface element.Additionally, the detector assembly is arranged about the at least oneedge of the interactive surface element.

Alternatively, the detector assembly is arranged along the at least oneedge of the interactive surface element.

Preferably, the detector assembly includes a support substrate and anarrangement of detector elements. Additionally, the detector assemblyalso includes a cover layer. Additionally or alternatively, the supportsubstrate is integrated with a housing of an interactive device.Preferably, the arrangement of detector elements includes a plurality ofdiscrete single-element detectors. Alternatively, the arrangement ofdetector elements includes an integrally formed multi-element detectorarray. In a further alternative embodiment, the arrangement of detectorelements includes a plurality of discrete multi-element detectors.Preferably, the cover layer is formed of a light transmissive material.

Alternatively, the cover layer includes a mask having apertures definedtherein. In another alternative embodiment, the cover layer includes afield-of-view defining mask having light-collimating tunnel-definingapertures. In a further alternative embodiment the cover layer includeslenses. Preferably, the at least one edge includes a mask havingapertures defined therein. Alternatively, the at least one edge includesa field-of-view defining mask having light-collimating tunnel-definingapertures. In another alternative embodiment, the at least one edgeincludes lenses.

Preferably, the at least one sensor includes a plurality of generallyforward-facing detectors arranged about edges of a display element.

Preferably, at least one detector in the arrangement detectselectromagnetic radiation at a baseline level and senses the position ofthe object with respect to the interactive surface element and thecircuitry provides an output according to location of at least onedetector in the arrangement for which at least one of the amount ofradiation detected and the change in the amount of radiation detectedexceed a first predetermined threshold. Additionally, the change in theamount of radiation detected results from at least one detector in thearrangement detecting reflected light from the object in addition todetecting the radiation at the baseline level.

Preferably, the reflected light propagates within the interactivesurface element coinciding with a viewing plane to at least one detectorin the arrangement. Alternatively, the reflected light propagates abovethe interactive surface element coinciding with a viewing plane to atleast one detector in the arrangement. In another alternative embodimentthe reflected light is transmitted through the interactive surfaceelement coinciding with a viewing plane directly to at least onedetector in the arrangement. Preferably, the at least one detector inthe arrangement detects radiation at the baseline level, senses theposition of the object with respect to the interactive surface elementand the circuitry provides the output according to location of at leastone detector in the arrangement at which the amount of radiationdetected is below a second predetermined threshold. Preferably, theinteractive assembly also includes a processing subassembly includingdetector analyzing processing circuitry operative to receive detectoroutputs of individual detectors in the arrangement, to determine atleast one of whether the amount of radiation detected by the individualdetectors exceeds the first predetermined threshold, whether the changein the amount of radiation detected by the individual detectors exceedsthe first predetermined threshold and whether the amount of radiationdetected by the individual detectors is below the second predeterminedthreshold, and to provide detector analysis outputs for the individualdetectors, array processing circuitry operative to receive the detectoranalysis outputs of individual detectors in the arrangement and togenerate an array detection output therefrom and position ascertainingcircuitry operative to receive the array detection output of thearrangement and to ascertain the position of the object therefrom.

Preferably, the array detection output includes informationcorresponding to the location of an impingement point of the object onthe interactive surface element coinciding with a viewing plane.Alternatively, the array detection output includes informationcorresponding to the location of the object relative to the interactivesurface element coinciding with a viewing plane.

Preferably, the radiation at the baseline level is provided by at leastone source of illumination external to the interactive device.Additionally, the at least one source of illumination includes at leastone of sunlight, artificial room lighting and IR radiation emitted froma human body. Alternatively or additionally, the interactive assemblyalso includes an illumination subassembly operative to provideillumination for augmenting the radiation at the baseline level.Alternatively or additionally, the interactive assembly also includes anillumination subassembly operative to provide the radiation at thebaseline level.

Preferably, the illumination subassembly includes at least oneelectromagnetic radiation emitting source. Additionally, the at leastone electromagnetic radiation emitting source includes at least one ofat least one IR emitting LED and at least one visible light emittingLED.

Preferably, the at least one electromagnetic radiation emitting sourceis disposed at an intersection of two mutually perpendicular edges ofthe interactive surface element coinciding with a viewing plane.Alternatively, the at least one electromagnetic radiation emittingsource forms part of a linear arrangement of display backlightsunderlying the interactive surface element coinciding with a viewingplane.

Preferably, the illumination subassembly includes at least one generallylinear arrangement of a plurality of electromagnetic radiation emittingsources arranged in parallel to at least one edge of the interactivesurface element coinciding with a viewing plane. Additionally, at leastone of the at least one generally linear arrangement is arranged behindthe at least one sensor.

There is also provided in accordance with another preferred embodimentof the present disclosure a position sensing assembly including aninteractive surface element defining a surface, at least one pixel arrayincluding a plurality of detector elements detecting electromagneticradiation at a baseline level, the at least one pixel array beingoperative to sense a position of an object with respect to the surfaceaccording to locations of ones of the plurality of detector elements atwhich at least one of the amount of radiation detected and the change inthe amount of radiation detected exceed a predetermined threshold, theat least one pixel array being operative to sense at least a position ofat least one object with respect to the at least one pixel array whenthe at least one object has at least a predetermined degree ofpropinquity to the at least one pixel array and circuitry receiving anoutput from the at least one pixel array and providing a non-imagewiseinput representing the position of the at least one object relative tothe at least one pixel array to utilization circuitry.

Preferably, the position sensing assembly also includes at least one IRilluminator for illuminating the at least one object when it has the atleast a predetermined degree of propinquity to the at least one pixelarray. Additionally, the at least one illuminator also functions as atleast one backlighting illuminator associated with a display associatedwith the at least one pixel array. Alternatively, the at least oneilluminator is located in a plane coplanar with or parallel to the atleast pixel array. Additionally or alternatively, the at least oneilluminator is located generally in the same plane as at least onebacklighting illuminator.

Preferably, the at least one pixel array senses light reflected from theat least one object. Additionally, the at least one pixel array sensesambient light reflected from the at least one object. Additionally oralternatively, the at least one pixel array senses IR light reflectedfrom the at least one object.

Preferably, the at least one object is at least one finger. Additionallyor alternatively, the at least one object is at least one positioningdevice.

Preferably, the position sensing assembly also includes utilizationcircuitry. Preferably, the utilization circuitry provides chordingfunctionality. Additionally or alternatively, the utilization circuitryprovides functionality to distinguish at least between positions of theat least one object when touching and not touching the device.Alternatively or additionally, the utilization circuitry providesfunctionality to distinguish at least between directions of motion ofthe at least one object towards and away from the device. Preferably,the utilization circuitry provides functionality to compute at least onecharacteristic of a trajectory of motion of the at least one objectgenerally parallel to the at least one pixel array. Additionally, the atleast one characteristic includes at least one of location, direction,velocity and change in direction.

Preferably, the utilization circuitry provides functionality for panningand scrolling. Additionally or alternatively, the utilization circuitryprovides functionality for one-handed zooming. Alternatively oradditionally, the utilization circuitry provides functionality foremploying a sensed distinction between instances when the at least oneobject touches and does not touch the device. Additionally oralternatively, the utilization circuitry provides functionality formouse over and click. Alternatively or additionally, the utilizationcircuitry provides functionality for turning pages. Additionally oralternatively, the utilization circuitry provides functionality forgaming. Alternatively or additionally, the utilization circuitryprovides functionality utilizing differences in sensed relativepositions of a user's fingers.

Preferably, the change in the amount of radiation detected results fromones of the plurality of detector elements detecting reflected lightfrom the object in addition to detecting the radiation at the baselinelevel. Additionally, the reflected light propagates within theinteractive surface element to ones of the plurality of detectorelements. Alternatively, the reflected light propagates above thesurface to ones of the plurality of detector elements. In anotheralternative embodiment, the reflected light is transmitted through theinteractive surface element directly to at least one of the plurality ofdetector elements. Preferably, the position sensing assembly alsoincludes a processing subassembly including detector analyzingprocessing circuitry operative to receive detector outputs of individualones of the plurality of detector elements, to determine whether atleast one of the amount of radiation and the change in the amount ofradiation detected by the individual ones of the plurality detectorelement exceeds the predetermined threshold, and to provide detectoranalysis outputs for the individual ones of the plurality of detectorelements, array processing circuitry operative to receive the detectoranalysis outputs of the plurality of detector elements of a single oneof the at least one pixel array and to generate an array detectionoutput therefrom and position ascertaining circuitry operative toreceive the array detection output of the at least one pixel array andto ascertain the position of the object therefrom.

Preferably, the array detection output includes informationcorresponding to the location of an impingement point of the object onthe surface. Alternatively, the array detection output includesinformation corresponding to the location of the object relative to thesurface. Preferably, the position of the object includes at least one ofa two-dimensional position of the object, a three-dimensional positionof the object and angular orientation of the object.

Preferably, the radiation at the baseline level is provided by at leastone source of radiation external to the position sensing assembly.Additionally, the at least one source of radiation includes at least oneof sunlight, artificial room lighting and IR radiation emitted from ahuman body. Preferably, the position sensing assembly also includes anillumination subassembly operative to provide illumination foraugmenting the radiation at the baseline level. Alternatively oradditionally, the position sensing assembly also includes anillumination subassembly operative to provide the radiation at thebaseline level to the plurality of detector elements. Preferably, theillumination subassembly includes at least one electromagnetic radiationemitting source. Additionally, the at least one electromagneticradiation emitting source includes at least one of at least one IRemitting LED and at least one visible light emitting LED.

Preferably, the at least one pixel array includes at least two pixelarrays arranged at mutually perpendicular edges of the plate.Additionally, the illumination subassembly includes an electromagneticradiation emitting source disposed at an intersection of two of the atleast two pixel arrays. Alternatively, the illumination subassemblyincludes an electromagnetic radiation emitting source disposed at anintersection of two mutually perpendicular edges of the plate, andacross from an intersection point of two of the at least two pixelarrays. In another alternative embodiment, the illumination subassemblyincludes at least one electromagnetic radiation emitting source formingpart of a linear arrangement of display backlights underlying the plate.Additionally, the at least one electromagnetic radiation emitting sourceincludes an IR emitting LED. Preferably, the illumination subassemblyincludes at least one generally linear arrangement of a plurality ofelectromagnetic radiation emitting sources arranged in parallel to atleast one edge of the plate. Additionally, at least one of the at leastone generally linear arrangement is arranged behind at least one of theat least two pixel arrays. Preferably, the at least one pixel array isarranged in a plane parallel to the surface. Additionally, theillumination subassembly includes at least one generally lineararrangement of a plurality of electromagnetic radiation emitting sourcesarranged in parallel to at least one edge of the plate. Alternatively,the illumination subassembly includes an electromagnetic radiationemitting source disposed at an intersection of two mutuallyperpendicular edges of the plate.

Preferably, the at least one pixel array includes a single pixel arrayarranged along an edge of the plate. Additionally, the illuminationsubassembly includes an electromagnetic radiation emitting sourcedisposed at an intersection of edges of the plate. Alternatively, theillumination subassembly includes at least one electromagnetic radiationemitting source forming part of a linear arrangement of displaybacklights underlying the plate. Additionally, the at least oneelectromagnetic radiation emitting source includes an IR emitting LED.

Preferably, the illumination subassembly includes at least one generallylinear arrangement of a plurality of electromagnetic radiation emittingsources arranged in parallel to at least one edge of the plate.Additionally, at least one of the at least one generally lineararrangement is arranged behind the single pixel array.

BRIEF DESCRIPTION OF THE DRAWINGS

The present disclosure will be more fully understood and appreciatedfrom the following detailed description, taken in conjunction with thedrawings in which:

FIGS. 1A, 1B, 1C, 1D, 1E and IF are simplified illustrations of sixtypes of interactive assemblies constructed and operative in accordancewith a preferred embodiment of the present disclosure;

FIGS. 2A and 2B are simplified illustrations of portions of two types ofintegrated display and input devices constructed and operative inaccordance with another preferred embodiment of the present disclosure,including detectors arranged in a plane parallel to a viewing plane;

FIGS. 3A and 3B are simplified illustrations of portions of two types ofintegrated display and input devices constructed and operative inaccordance with yet another preferred embodiment of the presentdisclosure, employing elements arranged in parallel planes, parallel toa viewing plane;

FIG. 4 is a simplified illustration of a portion of an input deviceconstructed and operative in accordance with still another preferredembodiment of the present disclosure, employing detectors arranged alongedges of a display element;

FIG. 5 is a simplified illustration of a portion of an input deviceconstructed and operative in accordance with a further preferredembodiment of the present disclosure, employing detectors arranged alongedges of a display element;

FIG. 6 is a simplified illustration of a portion of an input deviceconstructed and operative in accordance with a yet further preferredembodiment of the present disclosure, employing detectors arranged alongedges of a display element;

FIG. 7 is a simplified illustration of a portion of an input deviceconstructed and operative in accordance with an additional preferredembodiment of the present disclosure, employing detectors arranged alongedges of a display element;

FIGS. 8A, 8B, 8C and 8D are simplified illustrations of four alternativeembodiments of a portion of an input device constructed and operative inaccordance with another preferred embodiment of the present disclosureemploying detectors arranged along edges of a display element;

FIGS. 9A, 9B, 9C and 9D are simplified illustrations of four alternativeembodiments of a portion of an input device constructed and operative inaccordance with yet another preferred embodiment of the presentdisclosure, employing forward-facing detectors arranged about edges of adisplay element;

FIGS. 10A, 10B, 10C and 10D are simplified illustrations of fouralternative embodiments of a portion of an input device constructed andoperative in accordance with still another preferred embodiment of thepresent disclosure, employing forward-facing detectors arranged behindedges of a display element;

FIGS. 11A, 11B, 11C and 11D are simplified illustrations of fouralternative embodiments of a portion of an input device constructed andoperative in accordance with a further preferred embodiment of thepresent disclosure, employing forward-facing detectors arranged behindedges of a display element;

FIGS. 12A, 12B, 12C and 12D are simplified illustrations of fouralternative embodiments of a portion of an input device constructed andoperative in accordance with a yet further preferred embodiment of thepresent disclosure, employing detectors arranged along edges of adisplay element;

FIGS. 13A, 13B, 13C and 13D are simplified illustrations of fouralternative embodiments of a portion of an input device constructed andoperative in accordance with a still further preferred embodiment of thepresent disclosure, employing detectors arranged along edges of adisplay element;

FIGS. 14A, 14B, 14C and 14D are simplified illustrations of fouralternative embodiments of a portion of an input device constructed andoperative in accordance with an additional preferred embodiment of thepresent disclosure, employing forward-facing detectors arranged aboutedges of a display element;

FIGS. 15A, 15B, 15C and 15D are simplified illustrations of fouralternative embodiments of a portion of an input device constructed andoperative in accordance with another preferred embodiment of the presentdisclosure, employing forward-facing detectors arranged behind edges ofa display element;

FIGS. 16A, 16B, 16C and 16D are simplified illustrations of fouralternative embodiments of a portion of an input device constructed andoperative in accordance with yet another preferred embodiment of thepresent disclosure, employing forward-facing detectors arranged behindedges of a display element;

FIGS. 17A, 17B and 17C are simplified illustrations of three alternativeembodiments of a detector assembly forming part of an interactiveassembly constructed and operative in accordance with a preferredembodiment of the present disclosure;

FIGS. 18A, 18B, 18C, 18D, 18E and 18F are simplified illustrations ofsix alternative embodiments of an illumination subassembly forming partof an interactive assembly constructed and operative in accordance witha preferred embodiment of the present disclosure;

FIG. 19 is a simplified illustration of an interactive assemblyconstructed and operative in accordance with a preferred embodiment ofthe present disclosure, utilizing electromagnetic radiation from asource external to the interactive device;

FIGS. 20A, 20B, 21A, 21B and 22 are simplified illustrations of theoperation of an interactive assembly constructed and operative inaccordance with another preferred embodiment of the present disclosure;

FIGS. 23A, 23B, 23C, 23D and 23E are illustrations of user interfacefunctionality of a mobile device constructed and operative in accordancewith a preferred embodiment of the present disclosure;

FIGS. 24A and 24B are illustrations of user interface functionality of amobile device constructed and operative in accordance with a preferredembodiment of the present disclosure;

FIGS. 25A and 25B are illustrations of user interface functionality of amobile device constructed and operative in accordance with a preferredembodiment of the present disclosure; and

FIGS. 26A, 26B, 26C and 26D are illustrations of user interfacefunctionality of a mobile device constructed and operative in accordancewith a preferred embodiment of the present disclosure.

DETAILED DESCRIPTION

Reference is now made to FIGS. 1A, 1B, 1C, 1D, 1E and 1F, which aresimplified illustrations of six types of interactive assembliesconstructed and operative in accordance with a preferred embodiment ofthe present disclosure. These assemblies preferably include at least oneinteractive surface element, at least a first region of the at least oneinteractive surface element having first user sensible functionality andat least a second region of the at least one interactive surface elementhaving second functionality, different from the first user sensiblefunctionality, input sensor functionality, including at least one inputsensor located in propinquity to at least one of the at least oneinteractive surface element, operative to sense impingement of anelectromagnetic radiation spot on at least one of the at least one firstregion and the at least one second region of the at least oneinteractive surface element and utilization functionality for employingoutputs of the input sensor functionality in respect of impingement oneither or both of the at least one first region and the at least onesecond region.

The interactive assembly may also include at least one IR illuminatorfor illuminating at least one object when it has at least apredetermined degree of propinquity to the at least one interactivesurface element. Additionally, the illuminator may also function as abacklighting or frontlighting illuminator associated with the at leastone interactive surface element. Alternatively or additionally, theilluminator may be located in a plane coplanar with or parallel to theat least one input sensor. Alternatively or additionally, theilluminator may be located remotely from the at least one input sensorand/or from said at least one interactive surface element. In anotherpreferred embodiment, the illuminator is located generally in the sameplane as a backlighting illuminator associated with the at least oneinteractive surface element.

In one preferred embodiment, the at least one input sensor is preferablyoperable to sense light reflected from one or more objects having atleast a predetermined degree of propinquity to the at least oneinteractive surface element. The light sensed by the at least one inputsensor may be ambient light reflected from the at least one object. Thereflected IR light may be ambient IR light or IR light provided by theilluminator.

Alternatively or additionally, the light sensed by the at least oneinput sensor may be IR light originating from the at least one object.The at least one object may be at least one finger or for example astylus or remote control device or alternatively any other suitabledevice.

In another preferred embodiment, the interactive device utilizationcircuitry additionally may provide one or more or the followingfunctionalities: chording functionality, functionality to distinguish atleast between positions of the at least one object when touching and nottouching the device, functionality to distinguish at least betweendirections of motion of the at least one object towards and away fromthe device, functionality to compute at least one characteristic of atrajectory of motion of the at least one object relative to the pixelarray, the characteristic including at least one of location, direction,velocity and change in direction, functionality for panning andscrolling, functionality for one-handed zooming, functionality foremploying a sensed distinction between instances when the at least oneobject touches and does not touch the device, functionality for mouseover and click, functionality for turning pages, functionality forgaming, functionality for identifying at least one three-dimensionallocation of the at least one object relative to the interactive surfaceelement, functionality for identifying angle and/or orientation of theat least one object relative to the interactive surface, andfunctionality utilizing differences in sensed relative positions of auser's fingers.

FIG. 1A illustrates a mobile telephone 100 having multiple interactivesurface elements including a front interactive surface element 102, aback interactive surface element 104, a top edge interactive surfaceelement 106, a bottom edge interactive surface element (not shown) afirst side edge interactive surface element 108 and a second side edgeinteractive surface element (not shown). Preferably, at least one of theinteractive surface elements, at least a first region thereof, has firstuser sensible functionality and, at least a second region thereof, hassecond functionality, different from the first user sensiblefunctionality.

Thus, for example, in the illustrated embodiment of FIG. 1A, frontinteractive surface element 102 includes a first region 110 overlying adisplay 112, a second region 114 overlying function activation areas 116and a third region 118 defining a circumferential margin surroundingdisplay 112.

It is appreciated that the remaining interactive surface elements, suchas interactive surface elements 104, 106 and 108, may also includeplural regions having differing functionalities in the illustratedembodiment of FIG. 1A, the input sensor functionality preferablyincludes linear arrays of sensors distributed along edges of the variousinteractive surface elements. As seen in FIG. 1A, a linear array 120 ofsensors 122 is arranged along a side edge 124 of front interactivesurface element 102 and a linear array 130 of sensors 132 is arrangedalong a bottom edge 134 of front interactive surface element 102.Similar arrangements of sensor arrays are shown for interactive surfaceelements 104, 106 and 108. Sensors 122 and 132 are seen to be located inpropinquity to edge surfaces of the interactive surface elements and areoperative to sense impingement of an electromagnetic radiation spot (notshown) on at least one of the at least one first region, such as region110, and the at least one second region, such as region 114, of at leastone interactive surface element.

Suitable sensors 122 and 132 are, for example, Solderable SiliconPhotodiodes commercially available from Advanced Photonix Incorporatedof Camarillo, Calif., USA under catalog designator PDB-C601-1.Alternatively, a single array of sensors may be provided along only oneedge surface of an interactive surface element.

It is appreciated that an interactive surface element may form anintegral part of a display module, such as an LCD display module, mayform an integral part of a housing for such a display module, may beoverlaid thereupon, may be affixed thereto or may be separate therefrom.

FIG. 1B illustrates a large screen display 140, such as a televisiondisplay, having interactive functionality operative in accordance with apreferred embodiment of the present disclosure. The large screen display140 includes multiple interactive surface elements including a frontinteractive surface element 142, a back interactive surface element 144,a top edge interactive surface element (not shown), a bottom edgeinteractive surface element (not shown), a first side edge interactivesurface element 146 and a second side edge interactive surface element148. Preferably, at least one of the interactive surface elements, atleast a first region thereof, has first user sensible functionality and,at least a second region thereof, has second functionality, differentfrom the first user sensible functionality.

Thus, for example, in the illustrated embodiment of FIG. 1B, frontinteractive surface element 142 includes a first region 150 overlying adisplay area 152 and a second region 154 defining a circumferentialmargin surrounding display 152. Back interactive surface element 144typically includes a first region 156 overlying various types ofoperational indicators, such as indicator lights, and at least onesecond region 158 overlying various types of controls, such as POWERON/OFF, UPDATE FIRMWARE, DOWNLOAD, brightness controls and a volumelimiter.

It is appreciated that the remaining interactive surface elements, suchas interactive surface elements 146 and 148, may also include pluralregions having differing functionalities.

In the illustrated embodiment of FIG. 1B, the input sensor functionalitypreferably includes linear arrays of sensors distributed along edges ofthe various interactive surface elements. As seen in FIG. 1B, a lineararray 160 of forward-looking sensors 162 is arranged adjacent a sideedge 164 of front interactive surface element 142 and a linear array 166of forward-looking sensors 168 is arranged adjacent a bottom edge 169 offront interactive surface element 142. Similar arrangements of sensorarrays are shown for interactive surface elements 144, 146 and 148.Sensors 162 and 168 are seen to be located in propinquity to edgesurfaces of the interactive surface elements and are operative to senseimpingement of an electromagnetic radiation spot (not shown) on at leastone of the at least one first region and the at least one second regionof at least one interactive surface element. Alternatively, a singlearray of sensors may be provided along only one edge surface of aninteractive surface element. Interactive surface elements may include asingle layer or multiple layers and may have one or more coating layersassociated therewith.

It is appreciated that an interactive surface element may form anintegral part of a display module, such as an LCD display module, mayform an integral part of a housing for such a display module, may beoverlaid thereupon, may be affixed thereto or may be separate therefrom.

FIG. 1C illustrates a tablet computer 170 having interactivefunctionality operative in accordance with a preferred embodiment of thepresent disclosure. As seen in FIG. 1C, a multiplicity of light sensingelements 174 are interspersed among light emitting elements 176 arrangedin a plane 178. Examples of such a structure are described in U.S. Pat.No. 7,034,866 and U.S. Patent Application Publication Nos.2006/0132463A1, 2006/0007222A1 and 2004/00012565A1, the disclosures ofwhich are hereby incorporated by reference. Light, preferably includinglight in the IR band, for example, emitted by a light beam emittingstylus 180, propagates through a front interactive surface element 182and is detected by one or more of light sensing elements 174.

The tablet computer 170 may alternatively include multiple interactivesurface elements. Preferably, at least one of the interactive surfaceelements, at least a first region thereof, has first user sensiblefunctionality and, at least a second region thereof, has secondfunctionality, different from the first user sensible functionality.Thus, for example in the illustrated embodiment of FIG. 1C, frontinteractive surface element 182 includes a first region 190 overlying adisplay area 192 and a second region 194 defining a circumferentialmargin surrounding display 192. It is appreciated that additionalinteractive surface elements may also include plural regions havingdiffering functionalities. In the illustrated embodiment of FIG. 1C,similar arrangements of light detector elements may be provided foradditional interactive surface elements (not shown). It is appreciatedthat the additional interactive surface elements may include sensors ofthe type described hereinabove with respect to FIGS. 1A and 1B, sensorsof the type described hereinabove with respect to FIG. 1C or sensors ofany of the types described herein below. Alternatively, a single arrayof sensors may be provided along only one edge surface of an interactivesurface element. Interactive surface elements may include a single layeror multiple layers and may have one or more coating layers associatedtherewith.

It is appreciated that an interactive surface element may form anintegral part of a display module, such as an LCD display module, mayform an integral part of a housing for such a display module, may beoverlaid thereupon, may be affixed thereto or may be separate therefrom.

FIG. 1D illustrates a digital camera 200 having interactivefunctionality employing light reflection in accordance with a preferredembodiment of the present disclosure. The digital camera 200 may includea non-uniplanar interactive surface 202 which may surround one, some orall outer surfaces of the camera. Preferably, interactive surfaceelement 202, at least a first region thereof, has first user sensiblefunctionality and, at least a second region thereof, has secondfunctionality, different from the first user sensible functionality.

Thus, for example, in the illustrated embodiment of FIG. 1D, interactivesurface element 202 includes a first region 204 overlying a display area206 and a second region 208 overlying a top edge 210 of the camera. Itis appreciated that additional interactive surface elements may also beprovided and may include plural regions having differingfunctionalities.

In the illustrated embodiment of FIG. 1D, the input sensor functionalitypreferably includes an array 220 of sensing elements 222 arranged in aplane 224, parallel to a viewing plane 226. Alternatively, the array 220may be formed of one or more CCD or CMOS arrays or any other suitabletype of array and may be created by photolithography. It is appreciatedthat the plane 224 may be located at any suitable position with respectto the viewing plane 226, as illustrated for example in FIGS. 3A and 3B.As seen in the illustrated embodiment of FIG. 1D, array 220 is arrangedbehind an IR transmissive display panel 230, such as a panel includingLCD or OLED elements, underlying an interactive surface element 232coinciding with viewing plane 226. Interactive surface element 232 maybe a single or multiple layer plate and may have one or more coatinglayers associated therewith. In the illustrated example, there areprovided one or more light diffusing layers 234 overlying a reflector236. One or more collimating layers 238 are typically interposed betweenreflector 236 and IR transmissive display panel 230.

It is appreciated that an interactive surface element may form anintegral part of a display module, such as an LCD display module, mayform an integral part of a housing for such a display module, may beoverlaid thereupon, may be affixed thereto or may be separate therefrom.

FIG. 1E illustrates an interactive shop window system 240, having aninteractive functionality operative in accordance with a preferredembodiment of the present disclosure. The interactive shop window system240 preferably employs a front interactive surface element 242,preferably cooperating with a computer-driven display projector 244operative to project information, including images, on the interactivesurface element 242, which images are sensible by passersby. Interactivesurface element 242 has, at least a first region thereof, first usersensible functionality and, at least a second region thereof, secondfunctionality, different from the first user sensible functionality.Thus, for example, in the illustrated embodiment of FIG. 1E, frontinteractive surface element 242 includes a first region 250 on which animage 252 is projected and a second region 254. Both regions 250 and 254may sense a pointing finger in predetermined propinquity thereto.

In the illustrated embodiment of FIG. 1E, the input sensor functionalitypreferably includes linear arrays of sensors distributed along edges ofthe front interactive surface element 242. As seen in FIG. 1E, a lineararray 260 of angled generally forward-facing sensors 262 is arrangedadjacent a top edge 264 of front interactive surface element 242 and alinear array 266 of angled generally forward-facing sensors 268 isarranged along a side edge 270 of front interactive surface element 242.Sensors 262 and 268 are seen to be located in propinquity to edgesurfaces of the interactive surface element and are operative to senseimpingement of an electromagnetic radiation spot (not shown) on at leastone of the at least one first region, such as region 250, and the atleast one second region, such as region 254, of at least one interactivesurface element 242. It is appreciated that the interactive surfaceelement 242 preferably forms part of a shop window. Alternatively, theinteractive surface element 242 may form an integral part of a frame forshop window, may be overlaid thereupon, may be affixed thereto or may beseparate therefrom.

Alternatively, a single array of sensors may be provided along only oneedge surface of the interactive surface element 242. Interactive surfaceelements may include a single layer or multiple layers and may have oneor more coating layers associated therewith.

It is appreciated that an interactive surface element may form anintegral part of a display module, such as an LCD display module, mayform an integral part of a housing for such a display module, may beoverlaid thereupon, may be affixed thereto or may be separate therefrom.In the illustrated embodiment, passersby are invited by the projectedimage 252 to point at an object appearing in the store window. A fingerpointed at region 254 may choose a given item and the finger pointed atregion 250 may elicit, for example, SMS transmittal of a purchase offerto a cellular telephone 256 of one or both of the passersby. It isappreciated that, as described hereinabove, the interactivefunctionality of interactive shop window system 240 may be operative toprovide different responses to pointing at different regions, such asregions 250 and 254.

FIG. 1F illustrates an interactive assembly including a large screendisplay 270 having interactive functionality, such as a televisiondisplay of the type shown in FIG. 1B and described hereinabove, a mobiledevice 272, such as a mobile device of the type shown in FIG. 1A anddescribed hereinabove, and an interactive interface assembly 274, whichmay include one or more of an interactive docking station assembly 276for the mobile device 272 and an auxiliary sensor array 278 which may beretrofittably mounted onto or adjacent to large screen display 270.Interactive, interlinked and intercommunicating circuitry 279 ispreferably provided and may be embodied in a conventional set top box,or in any one or more of large screen display 270, mobile device 272 andinteractive interface assembly 274 for providing interactiveinterlinking and intercommunication between the various elements of theinteractive assembly. Alternatively, circuitry 279 may be embodied inone or more remote facilities and may communicate with the remainder ofthe assembly of FIG. 1F via the Internet, telephone, IPTV functionality,a cable communication link, satellite or any other suitablecommunications functionality. Connections between the various elementsmay include wired connections as shown as well as or alternativelywireless connections using suitable wireless technologies, such asBLUETOOTH® and WIFI.

The interactive docking station assembly 276 may include a supportassembly 280 on which speakers 282 may be located, for example, andwhich may include one or more generally forward looking linear arrays284 of sensors 286 distributed along one or more edges of the supportassembly 280. Preferably supported on support assembly 280 is a dockingcradle 288 which is arranged to interactively engage and support themobile device 272. One or more generally forward looking linear arrays290 of sensors 292 may be distributed along one or more edges of thedocking cradle 288.

It is appreciated that in various embodiments one or more of lineararrays 278, 284 and 290 may be obviated.

It is appreciated that an interactive surface element may form anintegral part of a display module, such as an LCD display module, mayform an integral part of a housing for such a display module, may beoverlaid thereupon, may be affixed thereto and may be separatetherefrom.

The interactive assembly of FIG. 1F may be operated in various modes ofoperation. A user, holding a light beam emitting remote control device292, may interact with one or more of the large screen display 270,mobile device 272, interactive interface assembly 274 and the dockingcradle 288 by directing a beam of light in a direction which causesimpingement of a spot of light on any one or more of large screendisplay 270, mobile device 272 and linear arrays 278, 284 and 290 ofinteractive interface assembly 274. It is appreciated that preferably,at least one, some or all of large screen display 270, mobile device272, interactive interface assembly 274 and the docking cradle 288, atleast a first region thereof, have first user sensible functionalityand, at least a second region thereof, have second functionality,different from the first user sensible functionality. Examples of suchregions appear in FIGS. 1A and 1B and are described hereinabove.

It is appreciated that an interactive surface element may form anintegral part of a display module, such as an LCD display module, mayform an integral part of a housing for such a display module, may beoverlaid thereupon, may be affixed thereto or may be separate therefrom.Reference is now made to FIGS. 2A and 2B, which are simplifiedillustrations of portions of two types of interactive assembliesconstructed and operative in accordance with another preferredembodiment of the present disclosure. FIG. 2A shows an interactiveassembly having touch responsive input functionality and/or propinquityresponsive input functionality, which is useful for applicationselection and operation, such as email communication and Internetsurfing. The input functionality may incorporate any one or morefeatures of assignee's U.S. Provisional Patent Application Nos.60/715,546; 60/734,027; 60/789,188 and 60/682,604, U.S. PatentApplication Publication No. 2005/0156914A1 and PCT Patent ApplicationPublication No. WO 2005/094176, the disclosures of which are herebyincorporated by reference.

FIG. 2A illustrates launching an application, such as an e-mailapplication, on a mobile telephone 300, by employing object detectionfunctionality of the type described herein below with reference to FIGS.18A-26D. As shown, a position of a user's finger is detected by means ofa touch responsive and/or propinquity responsive input functionalityoperative in accordance with a preferred embodiment of the presentdisclosure.

As seen in FIG. 2A, a multiplicity of light detector elements 302 areinterspersed among light emitters 304 arranged in a plane 306. Examplesof such a structure are described in U.S. Pat. No. 7,034,866 and U.S.Patent Application Publication Nos. 2006/0132463A1, 2006/0007222 A1 and2004/00012565A1, the disclosures of which are hereby incorporated byreference. Light, preferably including light in the IR band, reflectedby the user's finger, propagates through at least one cover layer 308and is detected by one or more of detector elements 302. The outputs ofdetector elements 302 are processed to indicate one or more of the X, Y,or Z positions, elevation and/or angular orientation of the user'sfinger. This detected position is utilized, as described herein belowand as taught, inter alia, in the aforesaid U.S. Provisional PatentApplication No. 60/789,188, and International Application Nos.PCT/IL2007/000332 and PCT/IL2007/000433, to launch an application orcontrol any of the other functionalities described therein.

It is appreciated that output circuitry in the interactive assemblyshown in FIG. 2A may preferably utilize the calculated X, Y coordinatedata to determine which region of which interactive element is beingselected and thus actuate the user-desired function accordingly.

The source of the reflected light may be external to the mobiletelephone 300, for example, as shown in FIG. 19. Suitable external lightsources include sunlight, artificial room lighting, IR radiation emittedfrom a human body or other heat source, or an external light sourcespecifically implemented for the purpose of illuminating the areaadjacent mobile telephone 300. In a preferred embodiment, the source ofthe reflected light may comprise an illumination subassembly 310associated with mobile telephone 300, which typically includes one ormore electromagnetic radiation emitting sources, here shown as multipleIR emitting LEDs 312. The illumination subassembly 310 preferably formspart of the interactive device. Examples of various suitableconfigurations of illumination subassembly 310 are described hereinbelow in FIGS. 18A-18F. Optionally, the light emitted by LEDs 312 may bemodulated by modulating circuitry (not shown).

It is a particular feature of the embodiment of FIG. 2A that lightdetector elements 302 are present on plane 306 in regions where thereare no light emitters 304 or where such light emitters are covered by ahousing 314, preferably generally opaque to visible light at theperiphery of at least one cover layer 308. Accordingly, mobile telephone300 has a first region, defined by cover layer 308, having first usersensible functionality and a second region, at the periphery of coverlayer 308 which is covered by housing 314, having second functionality,different from the first user sensible functionality.

FIG. 2B shows an interactive assembly having light beam impingementresponsive input functionality, which is useful for applicationselection and operation, such as email communication and Internetsurfing. The input functionality may incorporate any one or morefeatures of assignee's U.S. Provisional Patent Application Nos.60/715,546; 60/734,027; 60/789,188 and 60/682,604, U.S. PatentApplication Publication No. 2005/0156914A1 and PCT Patent ApplicationPublication No. WO 2005/094176, the disclosures of which are herebyincorporated by reference.

FIG. 2B illustrates launching an application, such as an e-mailapplication, on a mobile telephone 320, by employing object detectionfunctionality of the type described herein below with reference to18A-26D. A position of a stylus 322 is detected by means of a light beamresponsive input functionality operative in accordance with a preferredembodiment of the present disclosure. As seen in FIG. 2B, a multiplicityof light detector elements 324 are interspersed among light emitters 326arranged in a plane 328. Examples of such a structure are described inU.S. Pat. No. 7,034,866 and U.S. Patent Application Publication Nos.2006/0132463A1, 2006/0007222A1 and 2004/00012565 A1, the disclosures ofwhich are hereby incorporated by reference. Light, preferably includinglight in the IR band, emitted by stylus 322, propagates through at leastone cover layer 330 and is detected by one or more of detector elements324. The outputs of detector elements 324 are processed to indicate oneor more of the X, Y or Z positions, elevation of the stylus 322 and/orangular orientation of the stylus 322. This detected position isutilized, as taught inter alia in the aforesaid U.S. Provisional PatentApplication No. 60/789,188, and International Application Nos.PCT/IL2007/000332 and PCT/IL2007/000433, to launch an application orcontrol any of the other functionalities described in U.S. ProvisionalPatent Application Nos. 60/715,546; 60/734,027; 60/789,188 and60/682,604, U.S. Patent Application Publication No. 2005/0156914A1 andPCT Patent Application Publication No. WO 2005/094176.

It is appreciated that output circuitry in the interactive assemblyshown in FIG. 2B may preferably utilize the calculated X, Y coordinatedata to determine which region of which interactive element is beingselected and thus actuate the user-desired function accordingly.

It is a particular feature of the embodiment of FIG. 2B that lightdetector elements 324 are present on plane 328 in regions where thereare no light emitters 326 or where such light emitters are covered by ahousing 332, preferably generally opaque to visible light but mostlytransparent to IR light, at the periphery of at least one cover layer330. Accordingly mobile telephone 320 has a first region, defined bycover layer 330, having first user sensible functionality and a secondregion, at the periphery of cover layer 330 which is covered by housing332, having second functionality, different from the first user sensiblefunctionality.

Reference is now made to FIGS. 3 A and 3B, which are simplifiedillustrations of portions of two types of interactive assembliesconstructed and operative in accordance with yet another preferredembodiment of the present disclosure, employing elements arranged inparallel planes, parallel to a viewing plane. FIG. 3A shows anintegrated display and input system having touch responsive inputfunctionality and/or propinquity responsive input functionality, whichis useful for application selection and operation, such as emailcommunication and Internet surfing. The input functionality mayincorporate any one or more features of assignee's U.S. ProvisionalPatent Application Nos. 60/715,546; 60/734,027; 60/789,188 and60/682,604, U.S. Patent Application Publication No. 2005/0156914A1 andPCT Patent Application Publication No. WO 2005/094176, the disclosuresof which are hereby incorporated by reference.

The touch responsive functionality and/or propinquity responsive inputfunctionality preferably employs an integrated display and input systemincluding an array 340 of detector elements 342 arranged in a plane 343,parallel to a viewing plane 344. In accordance with a preferredembodiment of the present disclosure, the array 340 is formed of aplurality of discrete detector elements 342 placed on plane 343integrally formed therewith. Alternatively, the array 340 may be formedof one or more CCD or CMOS arrays, or may be created byphotolithography.

As seen in FIG. 3A, in one example of a display and input systemstructure, array 340 is arranged behind an IR transmissive display panel346, such as a panel including LCD or OLED elements, underlying aninteractive surface element 348 coinciding with viewing plane 344.Interactive surface element 348 may be a single or multiple layer plateand may have one or more coating layers associated therewith. In oneexample of an integrated display and input system employing an LCD,there are provided one or more light diffusing layers 350 overlying areflector 352. One or more collimating layers 354 are typicallyinterposed between reflector 352 and ER transmissive display panel 346.

FIG. 3A illustrates launching an application, such as an e-mailapplication, on a mobile telephone 356, by employing object detectionfunctionality of the type described herein below with reference to FIG.18A-26D. As shown, a position of a user's finger is detected by means ofa touch responsive and/or propinquity responsive input functionalityoperative in accordance with a preferred embodiment of the presentdisclosure. Light, preferably including light in the IR band, reflectedby the user's finger, propagates through plane 344 and panel 346 and isdetected by detector elements 342. The outputs of detector elements 342are processed to indicate one or more of the X, Y or Z positions and/orangular orientation of the user's finger. This detected position isutilized, as taught inter alia in the aforesaid U.S. Provisional PatentApplication No. 60/789,188 and International Application Nos.PCT/IL2007/000332 and PCT/IL2007/000433, to launch an application orcontrol any of the other functionalities described in U.S. ProvisionalPatent Application Nos. 60/715,546; 60/734,027; 60/789,188 and60/682,604, U.S. Patent Application Publication No. 2005/0156914A1 andPCT Patent Application Publication No. WO 2005/094176. It is appreciatedthat output circuitry in the interactive assembly shown in FIG. 3A maypreferably utilize the calculated X, Y coordinate data to determinewhich region of which interactive element is being selected and thusactuate the user-desired function accordingly.

The source of the reflected light may be external to the mobiletelephone 356, for example, as shown in FIG. 19. Suitable external lightsources include sunlight, artificial room lighting and IR radiationemitted from a human body or other heat source. In a preferredembodiment, the source of the reflected light may comprise anillumination subassembly 362 which typically includes one or moreelectromagnetic radiation emitting sources, here shown as multiple IRemitting LEDs 364. The illumination subassembly 362 preferably formspart of the interactive device. Examples of various suitableconfigurations of illumination subassembly 362 are described hereinbelow in FIGS. 18A-18F. Optionally, the light emitted by LEDs 364 may bemodulated by modulating circuitry (not shown).

It is a particular feature of the embodiment of FIG. 3A that lightdetector elements 342 are present on plane 343 in regions where thereare no light emitters 364 or where such light emitters are covered by ahousing 366, preferably opaque to visible light, at the periphery ofinteractive surface element 348. Accordingly, mobile telephone 356 has afirst region, defined by interactive surface element 348, having firstuser sensible functionality and a second region, overlying acircumferential margin and/or button zone at the periphery ofinteractive surface element 348, which is covered by housing 366, havingsecond functionality, different from the first user sensiblefunctionality.

FIG. 3B shows an interactive assembly having light beam impingementresponsive input functionality, which is useful for applicationselection and operation, such as email communication and Internetsurfing. The input functionality may incorporate any one or morefeatures of assignee's U.S. Provisional Patent Application Nos.60/715,546; 60/734,027; 60/789,188 and 60/682,604, U.S. PatentApplication Publication No. 2005/0156914A1 and PCT Patent ApplicationPublication No. WO 2005/094176, the disclosures of which are herebyincorporated by reference.

The light beam impingement responsive functionality preferably employsan integrated display and input system including an array 370 ofdetector elements 372 arranged in a plane 373, parallel to a viewingplane 374. In accordance with a preferred embodiment of the presentdisclosure the array 370 is formed of a plurality of discrete detectorelements 372 placed on plane 373 integrally formed therewith.Alternatively, the array 370 may be formed of one or more CCD or CMOSarrays, or may be created by photolithography. As seen in FIG. 3B, array370 is arranged behind an IR transmissive display panel 376, such as apanel including LCD or OLED elements, underlying an interactive surfaceelement 378 coinciding with viewing plane 374. Interactive surfaceelement 378 may be a single or multiple layer plate and may have one ormore coating layers associated therewith. In another example of anintegrated display and input device employing an LCD, interposed betweenarray 370 and IR transmissive display panel 376, there are provided oneor more light diffusing layers 380 overlying an IR transmissivereflector 382. One or more collimating layers 384 are typicallyinterposed between IR transmissive reflector 382 and IR transmissivedisplay panel 376.

FIG. 3B illustrates launching an application, such as an e-mailapplication, on a mobile telephone 386, by employing object detectionfunctionality of the type described hereinabove with reference to FIG.1D. A position of a stylus 388 is detected by means of a light beamresponsive input functionality operative in accordance with a preferredembodiment of the present disclosure. Light, preferably including lightin the IR band, emitted by stylus 388, propagates through plane 374,panel 376, one or more of layers 384 and layers 380 and through IRtransmissive reflector 382, and is detected by one or more of detectorelements 372. The outputs of detector elements 372 are processed toindicate one or more of the X, Y or Z positions, angle of elevationand/or angular orientation of the stylus 388. This detected position isutilized, as taught inter alia in the aforesaid U.S. Provisional PatentApplication No. 60/789,188, and International Application Nos.PCT/IL2007/000332 and PCT/IL2007/000433, to launch an application orcontrol any of the other functionalities described in U.S. ProvisionalPatent Application Nos. 60/715,546; 60/734,027; 60/789,188 and60/682,604, U.S. Patent Application Publication No. 2005/0156914A1 andPCT Patent Application Publication No. WO 2005/094176.

It is appreciated that output circuitry in the interactive assemblyshown in FIG. 3B may preferably utilize the calculated X, Y coordinatedata to determine which region of which interactive element is beingselected and thus actuate the user-desired function accordingly.

It is a particular feature of the embodiment of FIG. 3B that mobiletelephone 386 has a first region, defined by interactive surface element378 coinciding with IR transmissive display panel 376, having first usersensible functionality and a second region, at the periphery ofinteractive surface element 378 coinciding with a plane of a buttonactuation zone, which is covered by housing 390, preferably opaque tovisible light, having second functionality, different from the firstuser sensible functionality.

Reference is now made to FIG. 4, which is a simplified illustration of aportion of an input device constructed and operative in accordance withstill another preferred embodiment of the present disclosure, employingdetector elements arranged along edges of an interactive surfaceelement. In the structure of FIG. 4, at least one detector assembly 400is arranged along at least one edge 402 of an interactive surfaceelement 404, to sense light impinging thereon and propagating therein tothe edges 402 thereof. Interactive surface element 404 may be a singleor multiple layer plate and may have one or more coating layersassociated therewith. Interactive surface element 404 may be associatedwith a display panel, such as an LCD, whose viewing plane may optionallycoincide with a portion of the interactive surface element 404.Preferably, detector assemblies 400 are provided along at least twomutually perpendicular edges 402, as shown, though detector assemblies400 may be provided along all or most of edges 402. Alternatively, asingle detector assembly 400 may be provided along only one edge 402 ofinteractive surface element 404.

In accordance with a preferred embodiment of the present disclosure, thedetector assembly 400 comprises a support substrate 406 onto which ismounted a linear arrangement 408 of detector elements 410. Interposedbetween linear arrangement 408 and edge 402 is a cover layer 412. Coverlayer 412 may have multiple functions including physical protection,light intensity limitation, and field-of-view limitation and may haveoptical power. Cover layer 412 may be formed of glass or any othersuitable light transparent material, or of a suitably apertured opaquematerial, such as metal. Alternatively, cover layer 412 may be obviated.

The support substrate 406 may be mounted onto a display housing (notshown) or may be integrally formed therewith. The support substrate 406may alternatively be mounted onto an edge 402 of interactive surfaceelement 404. The support substrate 406 may be formed of a ceramicmaterial, a material such as FR-4 which is commonly used for PCBs,glass, plastic or a metal such as aluminum. The support substrate 406may also provide mounting for and electrical connections to the detectorelements 410. A processor 414 for processing the outputs of the detectorelements 410 may also be mounted on the support substrate 406.

It is a particular feature of this embodiment of the present disclosurethat the detector assembly 400 is extremely thin, preferably under 1 mmoverall. Accordingly, the support substrate 406 is preferably 50-200microns in thickness, the linear arrangement 408 of detector elements410 is preferably 100-400 microns in thickness and the cover layer 412is preferably 100-500 microns in thickness.

The input device, of which a portion is shown in FIG. 4, may alsoinclude a source of light which is external to the input device, forexample, as shown in FIG. 19. Suitable external light sources includesunlight, artificial room lighting and IR radiation emitted from a humanbody or other heat source. In a preferred embodiment of the presentdisclosure, the external light source is an external IR light emittingstylus, such as stylus 322 of FIG. 2B. In another preferred embodiment,the source of light may comprise an illumination subassembly 416 whichtypically includes one or more electromagnetic radiation emittingsources, here shown as multiple IR emitting LEDs 418 mounted about adisplay element 419, such as an LCD display. Display element 419 ispreferably smaller in area than the interactive surface element 404.

The illumination subassembly 416 may be associated with the displayelement 419, as described above, or may be associated with another partof the interactive device. Examples of various suitable configurationsof illumination subassembly 416 associated with an interactive surfaceare described herein below in FIGS. 18A-18F, it being appreciated thatsuch configurations may alternatively or additionally be associated witha display surface or any other suitable part of the device.

Optionally, the light emitted by LEDs 418 may be modulated by modulatingcircuitry (not shown).

It is a particular feature of the embodiment of FIG. 4 that interactivesurface element 404 has a first region, overlying display element 419and having first user sensible functionality and a second region,extending beyond display element 419, having second functionality,different from the first user sensible functionality.

It is a further particular feature of the embodiment of FIG. 4 that boththe first and second functionalities employ a common detector assembly,such as detector assembly 400, and may employ a common source of light,such as illumination subassembly 416.

It is appreciated that an interactive device, such as the devicesdescribed hereinabove with reference to FIGS. 1A-3B, may include one ormore multi-region interactive surface elements, one example of which isillustrated in FIG. 4, and other examples of which are described hereinbelow with reference to any one or more of FIGS. 5-17C.

It is appreciated that output circuitry in the input device shown inFIG. 4 may preferably utilize the calculated X, Y coordinate data todetermine which region of which interactive element is being selectedand thus actuate the user-desired function accordingly. Reference is nowmade to FIG. 5, which is a simplified illustration of a portion of aninput device constructed and operative in accordance with a furtherpreferred embodiment of the present disclosure, employing detectorelements arranged along edges of a display element. In the structure ofFIG. 5, at least one detector assembly 420 is arranged along at leastone edge 422 of an interactive surface element 424, coinciding with aviewing plane, to sense light impinging on interactive surface element424 and propagating within the interactive surface element 424 to theedges 422 thereof. Interactive surface element 424 may be a single ormultiple layer plate and may have one or more coating layers associatedtherewith. Preferably, detector assemblies 420 are provided along atleast two mutually perpendicular edges 422, as shown, though detectorassemblies 420 may be provided along all or most of edges 422.Alternatively, a single detector assembly 420 may be provided along onlyone edge 422 of interactive surface element 424.

In accordance with a preferred embodiment of the present disclosure, thedetector assembly 420 comprises a support substrate 426 onto which ismounted a linear arrangement 428 of detector elements 430. Interposedbetween linear arrangement 428 and edge 422 is a cover layer 432. Li theillustrated embodiment, cover layer 432 is a field-of-view defining maskhaving apertures 433 formed therein, in sizes and arrangements whichprovide desired fields-of-view for the various corresponding detectorelements 430. Depending on the thickness of layer 432, each detectorelement 430 may have associated therewith a single aperture 433 or aplurality of smaller apertures, here designated by reference numeral434. The selection of aperture size and distribution is determined inpart by the mechanical strength of layer 432. Layer 432 may havemultiple functions including physical protection, field-of-viewlimitation and light intensity limitation, and may have optical power.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances position discrimination by limiting overlap betweenthe fields-of-view of adjacent detector elements 430. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of apertures 433 and their locations with respect to anddistances from detector elements 430. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 430 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 430 to a solidangle of less than or equal to 7 degrees.

The support substrate 426 may be mounted onto a display housing (notshown) or may be integrally formed therewith. The support substrate 426may alternatively be mounted onto an edge 422 of interactive surfaceelement 424. The support substrate 426 may be formed of a ceramicmaterial, a material such as FR-4 which is commonly used for PCBs,glass, plastic or a metal such as aluminum. The support substrate 426may also provide mounting for and electrical connections to the detectorelements 430. A processor 435 for processing the outputs of the detectorelements 430 may also be mounted on the support substrate 426.

The input device shown in FIG. 5 may also include a source of lightwhich is preferably external to the input device, for example, as shownin FIG. 19.

Suitable external light sources include sunlight, artificial roomlighting and IR radiation emitted from a human body or other heatsource. In a preferred embodiment of the present disclosure, theexternal light source is an external IR light emitting stylus, such asstylus 322 of FIG. 2B. In an alternate preferred embodiment, the sourceof light may comprise an illumination subassembly 436 which typicallyincludes one or more electromagnetic radiation emitting sources, hereshown as multiple IR emitting LEDs 438 mounted about a display element439, such as an LCD display. Display element 439 is preferably smallerin area than the interactive surface element 424.

The illumination subassembly 436 may be associated with the displayelement 439, as described above, or may be associated with another partof the interactive device. Examples of various suitable configurationsof illumination subassembly 436 associated with an interactive surfaceare described herein below in FIGS. 18A-18F, it being appreciated thatsuch configurations may alternatively or additionally be associated witha display surface or any other suitable part of the device. Optionally,the light emitted by LEDs 438 may be modulated by modulating circuitry(not shown).

It is a particular feature of the embodiment of FIG. 5 that interactivesurface element 424 has a first region, overlying display element 439,having first user sensible functionality and a second region, extendingbeyond display element 439, having second functionality, different fromthe first user sensible functionality.

It is a further particular feature of the embodiment of FIG. 5 that boththe first and second functionalities employ a common detector assembly,such as detector assembly 420 and may employ a common source of light,such as illumination subassembly 436. It is appreciated that aninteractive device, such as the devices described hereinabove withreference to FIGS. 1A-3B, may include one or more multi-regioninteractive surface elements, one example of which is illustrated inFIG. 5, and other examples of which are described hereinabove and hereinbelow with reference to any one or more of FIGS. 4 and 6-17C. It isappreciated that output circuitry in the input device shown in FIG. 5may preferably utilize the calculated X, Y coordinate data to determinewhich region of which interactive element is being selected and thusactuate the user-desired function accordingly.

Reference is now made to FIG. 6, which is a simplified illustration of aportion of an input device constructed and operative in accordance witha yet further preferred embodiment of the present disclosure, employingdetector elements arranged along edges of a display element. In thestructure of FIG. 6, at least one detector assembly 440 is arrangedalong at least one edge 442 of an interactive surface element 444,coinciding with a viewing plane, to sense light impinging on interactivesurface element 444 and propagating within the interactive surfaceelement 444 to the edges 442 thereof. Interactive surface element 444may be a single or multiple layer plate and may have one or more coatinglayers associated therewith. Preferably, detector assemblies 440 areprovided along at least two mutually perpendicular edges 442, as shown,though detector assemblies 440 may be provided along all or most ofedges 442. Alternatively, a single detector assembly 440 may be providedalong only one edge 442 of interactive surface element 444.

In accordance with a preferred embodiment of the present disclosure, thedetector assembly 440 comprises a support substrate 446 onto which ismounted a linear arrangement 448 of detector elements 450. Interposedbetween linear arrangement 448 and edge 442 is a cover layer 452. Theembodiment of FIG. 6 differs from that of FIG. 5 in that the cover layer452 is substantially thicker than cover layer 432 and is preferably atleast 200 microns in thickness. Layer 452 has apertures 453 formedtherein, which apertures 453 define light collimating tunnels. Apertures453 are formed in layer 452, in sizes and arrangements which providedesired fields-of-view for the various corresponding detector elements450. Depending on the thickness of layer 452, each detector element 450may have associated therewith a single tunnel-defining aperture 453, asshown, or a plurality of smaller tunnel-defining apertures. Theselection of aperture size and distribution is determined in part by themechanical strength of layer 452. Layer 452 may have multiple functionsincluding physical protection, field-of-view limitation and lightintensity limitation, and may have optical power.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances position discrimination by limiting overlap betweenthe fields-of-view of adjacent detector elements 450. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of apertures 453 and their locations with respect to anddistances from detector elements 450. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 450 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 450 to a solidangle of less than or equal to 7 degrees.

The support substrate 446 may be mounted onto a display housing (notshown) or may be integrally formed therewith. The support substrate 446may alternatively be mounted onto an edge 442 of interactive surfaceelement 444. The support substrate 446 may be formed of a ceramicmaterial, a material such as FR-4 which is commonly used for PCBs,glass, plastic or a metal such as aluminum. The support substrate 446may also provide mounting for and electrical connections to the detectorelements 450. A processor 454 for processing the outputs of the detectorelements 450 may also be mounted on the support substrate 446.

The input device shown in FIG. 6 may also include a source of lightwhich is preferably external to the input device, for example, as shownin FIG. 19 in a preferred embodiment of the present disclosure, theexternal light source is an external IR light emitting stylus, such asstylus 322 of FIG. 2B. Suitable external light sources include sunlight,artificial room lighting and IR radiation emitted from a human body orother heat source.

In an alternate preferred embodiment, the source of light may compriseone or more illumination subassemblies 456 which typically include oneor more electromagnetic radiation emitting sources, here shown asmultiple IR emitting LEDs 458, mounted on interactive surface element444 and/or about a display element 459, such as an LCD display. Displayelement 459 is preferably smaller in area than the interactive surfaceelement 444.

It is appreciated that different illumination subassemblies 456 may emitradiation in the same wavelength or in different wavelengths.

The illumination subassemblies 456 may be associated with the displayelement 459, as described above, or may be associated with another partof the interactive device. Examples of various suitable configurationsof illumination subassemblies 456 associated with an interactive surfaceare described herein below in FIGS. 18A-18F, it being appreciated thatsuch configurations may alternatively or additionally be associated witha display surface or any other suitable part of the device. Optionally,the light emitted by LEDs 458 may be modulated by modulating circuitry(not shown).

It is a particular feature of the embodiment of FIG. 6 that interactivesurface element 444 has a first region, overlying display element 459,having first user sensible functionality and a second region, extendingbeyond display element 459, having second functionality, different fromthe first user sensible functionality.

It is a further particular feature of the embodiment of FIG. 6 that boththe first and second functionalities employ a common detector assembly,such as detector assembly 440 and may employ a common source of light,such as illumination subassemblies 456. It is appreciated that outputcircuitry in the input device shown in FIG. 6 may preferably utilize thecalculated X, Y coordinate data to determine which region of whichinteractive element is being selected and thus actuate the user-desiredfunction accordingly.

It is appreciated that an interactive device, such as the devicesdescribed hereinabove with reference to FIGS. 1A-3B, may include one ormore multi-region interactive surface elements, one example of which isillustrated in FIG. 6, and other examples of which are describedhereinabove and herein below with reference to any one or more of FIGS.4-5 and 7-17C.

Reference is now made to FIG. 7, which is a simplified illustration of aportion of an input device constructed and operative in accordance withan additional preferred embodiment of the present disclosure, employingdetector elements arranged along edges of a display element. In thestructure of FIG. 7, at least one detector assembly 460 is arrangedalong at least one edge 462 of an interactive surface element 464,coinciding with a viewing plane, to sense light impinging on interactivesurface element 464 and propagating within the interactive surfaceelement 464 to the edges 462 thereof. Interactive surface element 464may be a single or multiple layer plate and may have one or more coatinglayers associated therewith. Preferably, detector assemblies 460 areprovided along at least two mutually perpendicular edges 462, as shown,though detector assemblies 460 may be provided along all or most ofedges 462. Alternatively, a single detector assembly 460 may be providedalong only one edge 462 of interactive surface element 464. Inaccordance with a preferred embodiment of the present disclosure, thedetector assembly 460 comprises a support substrate 466 onto which ismounted a linear arrangement 468 of detector elements 470. Interposedbetween linear arrangement 468 and edge 462 is a cover layer 472.

The embodiment of FIG. 7 differs from that of FIGS. 5 and 6 in thatapertures in the cover layer in FIGS. 5 and 6 are replaced by lenses 473formed in cover layer 472. Lenses 473 may be integrally formed withlayer 472 or may be discrete elements fitted within suitably sized andpositioned apertures in an opaque substrate. Lenses 473 may beassociated with tunnel-defining apertures or may comprise an array ofmicrolenses aligned with one or more of detector elements 470. Layer 472may have multiple functions including physical protection, field-of-viewlimitation and light intensity limitation, and may have optical power.Field-of-view limiting functionality may be desirable in this contextbecause it enhances position discrimination by limiting overlap betweenthe fields-of-view of adjacent detector elements 470. The supportsubstrate 466 may be mounted onto a display housing (not shown) or maybe integrally formed therewith. The support substrate 466 mayalternatively be mounted onto an edge 462 of interactive surface element464. The support substrate 466 may be formed of a ceramic material, amaterial such as FR-4 which is commonly used for PCBs, glass, plastic ora metal such as aluminum. The support substrate may also providemounting for and electrical connections to the detector elements 470. Aprocessor 474 for processing the outputs of the detector elements 470may also be mounted on the support substrate 466.

The input device shown in FIG. 7 may also include a source of lightwhich is preferably external to the input device, for example, as shownin FIG. 19. In a preferred embodiment of the present disclosure, theexternal light source is an external IR light emitting stylus, such asstylus 322 of FIG. 2B. Suitable external light sources include sunlight,artificial room lighting and ER radiation emitted from a human body orother heat source. In an alternate preferred embodiment, the source oflight may comprise one or more illumination subassemblies 476 whichtypically include one or more electromagnetic radiation emittingsources, here shown as multiple IR emitting LEDs 478 mounted oninteractive surface element 464 and/or about a display element 479, suchas an LCD display. Display element 479 is preferably smaller in areathan the interactive surface element 464.

It is appreciated that different illumination subassemblies 476 may emitradiation in the same wavelength or in different wavelengths.

The illumination subassemblies 476 may be associated with the displayelement 479, as described above, or may be associated with another partof the interactive device. Examples of various suitable configurationsof illumination subassemblies 476 associated with an interactive surfaceare described herein below in FIGS. 18A-18F, it being appreciated thatsuch configurations may alternatively or additionally be associated witha display surface or any other suitable part of the device. Optionally,the light emitted by LEDs 478 may be modulated by modulating circuitry(not shown).

It is a particular feature of the embodiment of FIG. 7 that interactivesurface element 464 has a first region, overlying display element 479,having first user sensible functionality and a second region, extendingbeyond display element 479, having second functionality, different fromthe first user sensible functionality.

It is a further particular feature of the embodiment of FIG. 7 that boththe first and second functionalities employ a common detector assembly,such as detector assembly 460 and may employ a common source of light,such as illumination subassemblies 476. It is appreciated that outputcircuitry in the input device shown in FIG. 7 may preferably utilize thecalculated X, Y coordinate data to determine which region of whichinteractive element is being selected and thus actuate the user-desiredfunction accordingly.

It is appreciated that an interactive device, such as the devicesdescribed hereinabove with reference to FIGS. 1A-3B, may include one ormore multi-region interactive surface elements, one example of which isillustrated in FIG. 7, and other examples of which are described hereinbelow with reference to any one or more of FIGS. 4-6 and 8A-17C.

Reference is now made to FIGS. 8A-8D, which are simplified illustrationsof four alternative embodiments of a portion of an input deviceconstructed and operative in accordance with another preferredembodiment of the present disclosure, employing detector elementsarranged along edges of a display element in the structure of FIGS. 8A-8D, at least one detector assembly 500 is arranged along at least oneedge 502 of an interactive surface element 504, coinciding with aviewing plane, to sense light impinging on interactive surface element504 and propagating within interactive surface element 504 to the edges502 thereof. Interactive surface element 504 may be a single or multiplelayer interactive surface element and may have one or more coatinglayers associated therewith. Preferably, detector assemblies 500 areprovided along at least two mutually perpendicular edges 502, thoughdetector assemblies 500 may be provided along all or most of edges 502.Alternatively, a single detector assembly 500 may be provided along onlyone edge 502 of interactive surface element 504 in accordance with apreferred embodiment of the present disclosure, the detector assembly500 comprises a support substrate 506 onto which is mounted a lineararrangement 508 of detector elements 510. As distinct from theembodiments of FIGS. 4-7, in the embodiments of FIGS. 8A-8D, the coverlayer is obviated and its functionality is provided by suitableconditioning of edge 502 of interactive surface element 504. Thisfunctionality may provide some, all or none of the following multiplefunctions: physical protection, light intensity limitation,field-of-view limitation, and optical power. The support substrate 506may be mounted onto a display housing (not shown) or may be integrallyformed therewith. The support substrate 506 may alternatively be mountedonto an edge 502 of interactive surface element 504. The supportsubstrate 506 may be formed of a ceramic material, a material such asFR-4 which is commonly used for PCBs, glass, plastic or a metal such asaluminum. The support substrate may also provide mounting for andelectrical connections to the detector elements 510. A processor 514 forprocessing the outputs of the detector elements 510 may also be mountedon the support substrate 506.

It is a particular feature of the embodiments of FIGS. 8A-8D of thepresent disclosure that the detector assembly 500 is extremely thin,preferably under 1 mm overall. Accordingly, the support substrate 506 ispreferably 50-200 microns in thickness and the linear arrangement 508 ofdetector elements 510 is preferably 100-400 microns in thickness.

The input devices shown in FIG. 8A-8D may also include a source of lightwhich is preferably external to the input device, for example, as shownin FIG. 19. In a preferred embodiment of the present disclosure, theexternal light source is an external IR light emitting stylus, such asstylus 322 of FIG. 2B. Suitable external light sources include sunlight,artificial room lighting and IR radiation emitted from a human body orother heat source.

In alternative preferred embodiments, the source of light may comprisean illumination subassembly 516 which typically includes one or moreelectromagnetic radiation emitting sources, here shown as multiple IRemitting LEDs 518 mounted about interactive surface element 504. Asshown in FIGS. 8A-8D, interactive surface element 504 is preferablyassociated with a display element 519, such as an LCD display. Displayelement 519 is preferably smaller in area than the interactive surfaceelement 504.

The illumination subassembly 516 may be associated with interactivesurface element 504, as described above, or may be associated withanother part of the interactive device, such as display element 519.Examples of various suitable configurations of illumination subassembly516 associated with an interactive surface are described herein below inFIGS. 18A-18F, it being appreciated that such configurations mayalternatively or additionally be associated with a display surface orany other suitable part of the device. Optionally, the light emitted byLEDs 518 may be modulated by modulating circuitry (not shown).

It is a particular feature of the embodiments of FIGS. 8 A-8D thatinteractive surface element 504 has a first region, overlying displayelement 519, having first user sensible functionality and a secondregion, extending beyond display element 519, having secondfunctionality, different from the first user sensible functionality.

It is a further particular feature of the embodiments of FIGS. 8A-8Dthat both the first and second functionalities employ a common detectorassembly, such as detector assembly 500 and may employ a common sourceof light, such as illumination subassembly 516.

It is appreciated that output circuitry in the input devices shown inFIGS. 8A-8D may preferably utilize the calculated X, Y coordinate datato determine which region of which interactive element is being selectedand thus actuate the user-desired function accordingly.

It is appreciated that an interactive device, such as the devicesdescribed hereinabove with reference to FIGS. 1A-3B, may include one ormore multi-region interactive surface elements, examples of which areillustrated in FIGS. 8A-8D, and other examples of which are describedhereinabove and herein below with reference to any one or more of FIGS.4-7 and 9A-17C.

In the embodiment of FIG. 8A, edge 502 is uniformly polished forunimpeded light transmission therethrough to linear arrangement 508 ofdetector elements 510. Alternatively, edge 502 may be untreated orunconditioned. Reference is now made to FIG. 8B, in which it is seenthat edge 502 is conditioned to define a field-of-view defining mask 520having apertures 533 formed therein in sizes and arrangements whichprovide desired fields-of-view for the various corresponding detectorelements 510. Each detector element 510 may have associated therewith asingle aperture 533, as shown, or a plurality of smaller apertures.Field-of-view limiting functionality may be desirable in this contextbecause it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 510. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of apertures 533 and their locations with respect to anddistances from detector elements 510. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 510 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 510 to a solidangle of less than or equal to 7 degrees. Reference is now made to FIG.8C, which differs from that of FIG. 8B in that apertures 533 in mask 520are replaced by light collimating tunnel-defining apertures 540 in amask 542.

Each detector element 510 may have associated therewith a singletunnel-defining aperture 540, as shown, or a plurality of smallertunnel-defining apertures.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 510. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of apertures 540 and their locations with respect to anddistances from detector elements 510 in accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 510 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 510 to a solidangle of less than or equal to 7 degrees.

Reference is now made to FIG. 8D, which differs from that of FIGS. 8Band 8C in that the apertures in FIGS. 8B and 8C are replaced by lenses553. Lenses 553 may be integrally formed at edges 502 or may be discreteelements fitted within suitably sized and positioned apertures ininteractive surface element 504. Lenses 553 may be associated withtunnel-defining apertures or may comprise an array of microlensesaligned with one or more of detector elements 510.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 510. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of lenses 553 and their locations with respect to anddistances from detector elements 510. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 510 to a solid angleof less than or equal to 15 degrees, in accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 510 to a solidangle of less than or equal to 7 degrees.

Reference is now made to FIGS. 9A, 9B, 9C and 9D, which are simplifiedillustrations of four alternative embodiments of a portion of an inputdevice constructed and operative in accordance with yet anotherpreferred embodiment of the present disclosure, employing forward-facingdetector elements arranged about edges of a display element.

In the structure of FIGS. 9A-9D, at least one detector assembly 600 isarranged about at least one edge 602 of an interactive surface element604, coinciding with a viewing plane, to sense light impinging directlyonto detector assembly 600. Interactive surface element 604 may be asingle or multiple layer plate and may have one or more coating layersassociated therewith. Light, preferably including light in the IR band,is emitted by a light beam emitter, such as light beam emitting stylus180 in the embodiment of FIG. 1C or the light beam emitting remotecontrol device 292 of FIG. 1F, or a light reflecting object, as in theembodiment of FIG. 1D. Preferably, detector assemblies 600 are providedalong at least two mutually perpendicular edges 602, though detectorassemblies 600 may be provided along all or most of edges 602.Alternatively, a single detector assembly 600 may be provided along onlyone edge 602 of interactive surface element 604. In accordance with apreferred embodiment of the present disclosure, the detector assembly600 comprises a support substrate 606 onto which is mounted a lineararrangement 608 of detector elements 610. As distinct from theembodiments of FIGS. 8A-8D, there is provided a cover layer 612 and asdistinct from the embodiments of FIGS. 4-7, the detector assembly 600and the detector elements 610 are generally forward facing, in the senseillustrated generally in FIG. 1B and described hereinabove with respectthereto. The cover layer 612 may provide multiple functions includingphysical protection, light intensity limitation and field-of-viewlimitation, and may have optical power.

The support substrate 606 may be mounted onto a display housing (notshown) or may be integrally formed therewith. The support substrate 606may alternatively be mounted onto an edge 602 of interactive surfaceelement 604. The support substrate 606 may be formed of a ceramicmaterial, a material such as FR-4 which is commonly used for PCBs,glass, plastic or a metal such as aluminum. The support substrate mayalso provide mounting for and electrical connections to the detectorelements 610. A processor 614 for processing the outputs of the detectorelements 610 may also be mounted on the support substrate 606.

It is a particular feature of this embodiment of the present disclosurethat the detector assembly 600 is extremely thin, preferably under 1 mmoverall.

Accordingly, the support substrate 606 is preferably 50-200 microns inthickness and the linear arrangement 608 of detector elements 610 ispreferably 100-400 microns in thickness and the cover layer 612 ispreferably 100-500 microns in thickness.

The input devices shown in FIG. 9A-9D may also include a source of lightwhich is preferably external to the input device, for example, as shownin FIG. 19. In a preferred embodiment of the present disclosure, theexternal light source is an external IR light emitting stylus, such asstylus 322 of FIG. 2B. Suitable external light sources include sunlight,artificial room lighting and IR radiation emitted from a human body orother heat source.

In alternative preferred embodiments, the source of light may comprisean illumination subassembly 616 which typically includes one or moreelectromagnetic radiation emitting sources, here shown as multiple IRemitting LEDs 618 mounted about interactive surface element 604. Asshown in FIGS. 9A-9D, interactive surface element 604 is preferablyassociated with a display element 619, such as an LCD display. Displayelement 619 is preferably smaller in area than the interactive surfaceelement 604.

The illumination subassembly 616 may be associated with interactivesurface element 604, as described above, or may be associated withanother part of the interactive device, such as display element 619.Examples of various suitable configurations of illumination subassembly616 associated with an interactive surface are described herein below inFIGS. 18A-18F, it being appreciated that such configurations mayalternatively or additionally be associated with a display surface orany other suitable part of the device. Optionally, the light emitted byLEDs 618 may be modulated by modulating circuitry (not shown).

It is a particular feature of the embodiments of FIGS. 9 A-9D thatinteractive surface element 604 has a first region, overlying displayelement 619, having first user sensible functionality and a secondregion, extending beyond display element 619, having secondfunctionality, different from the first user sensible functionality.

It is a further particular feature of the embodiments of FIGS. 9A-9Dthat both the first and second functionalities employ a common detectorassembly, such as detector assembly 600 and may employ a common sourceof light, such as illumination subassembly 616.

It is appreciated that output circuitry in the input devices shown inFIGS. 9A-9D may preferably utilize the calculated X, Y coordinate datato determine which region of which interactive element is being selectedand thus actuate the user-desired function accordingly.

It is appreciated that an interactive device, such as the devicesdescribed hereinabove with reference to FIGS. 1A-3B, may include one ormore multi-region interactive surface elements, examples of which areillustrated in FIGS. 9A-9D, and other examples of which are describedhereinabove and herein below with reference to any one or more of FIGS.4-8D and 10A-17C.

In the embodiment of FIG. 9A, cover layer 612 is formed of glass or anyother suitable light transparent material.

Reference is now made to FIG. 9B, in which it is seen that cover layer612 includes a field-of-view defining mask 620 having apertures 633formed therein in sizes and arrangements which provide desiredfields-of-view for the various corresponding detector elements 610. Eachdetector element 610 may have associated therewith a single aperture633, as shown, or a plurality of smaller apertures.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 610. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of apertures 633 and their locations with respect to anddistances from detector elements 610. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 610 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 610 to a solidangle of less than or equal to 7 degrees.

Reference is now made to FIG. 9C, which differs from that of FIG. 9B inthat apertures 633 in mask 620 are replaced by light collimatingtunnel-defining apertures 640 in a mask 642.

Each detector element 610 may have associated therewith a singletunnel-defining aperture 640, as shown, or a plurality of smallertunnel-defining apertures.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 610. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of apertures 640 and their locations with respect to anddistances from detector elements 610. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 610 to a solid angleof less than or equal to 15 degrees, in accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 610 to a solidangle of less than or equal to 7 degrees.

Reference is now made to FIG. 9D, which differs from that of FIGS. 9Band 9C in that the apertures in FIGS. 9B and 9C are replaced by lenses653. Lenses 653 may be integrally formed with cover layer 612 or may bediscrete elements fitted within suitably sized and positioned aperturesin cover layer 612. Lenses 653 may be associated with tunnel-definingapertures or may comprise an array of microlenses aligned with one ormore of detector elements 610.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 610. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of lenses 653 and their locations with respect to anddistances from detector elements 610. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 610 to a solid angleof less than or equal to 15 degrees, in accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 610 to a solidangle of less than or equal to 7 degrees.

Reference is now made to FIGS. 10A, 10B, 10C and 10D, which aresimplified illustrations of four alternative embodiments of a portion ofan input device constructed and operative in accordance with stillanother preferred embodiment of the present disclosure, employingforward-facing detector elements arranged behind edges of a displayelement.

In the structure of FIGS. 10A-10D; at least one detector assembly 700 isarranged behind at least one edge 702 of an interactive surface element704, coinciding with a viewing plane, to sense light impinging ontodetector assembly 700 after propagating through interactive surfaceelement 704. Interactive surface element 704 may be a single or multiplelayer plate and may have one or more coating layers associatedtherewith. The light, preferably including light in the IR band, isemitted by a light beam emitter, such as light beam emitting stylus 180in the embodiment of FIG. 1C or the light beam emitting remote controldevice 292 of FIG. 1F, or a light reflecting object, as in theembodiment of FIG. 1D. Preferably, detector assemblies 700 are providedbehind at least two mutually perpendicular edges 702, though detectorassemblies 700 may be provided behind all or most of edges 702.Alternatively, a single detector assembly 700 may be provided behindonly one of edges 702. In accordance with a preferred embodiment of thepresent disclosure, the detector assembly 700 comprises a supportsubstrate 706 onto which is mounted a linear arrangement 708 of detectorelements 710. Similarly to the embodiments of FIGS. 9A-9D, there isprovided a cover layer 712 and as distinct from the embodiments of FIGS.4-7, the detector assembly 700 and the detector elements 710 aregenerally forward facing, in the sense illustrated generally in FIG. 1Band described hereinabove with respect thereto. The cover layer 712 mayprovide multiple functions including physical protection, lightintensity limitation and field-of-view limitation, and may have opticalpower. Alternatively, cover layer 712 may be obviated.

The support substrate 706 may be mounted onto a display housing (notshown) or may be integrally formed therewith. The support substrate 706may alternatively be mounted onto a rearward facing surface 713 ofinteractive surface element 704 at the edge 702 lying in front of thelinear arrangement 708. The support substrate 706 may be formed of aceramic material, a material such as FR-4 which is commonly used forPCBs, glass, plastic or a metal such as aluminum. The support substrate706 may also provide mounting for and electrical connections to thedetector elements 710. A processor 714 for processing the outputs of thedetector elements 710 may also be mounted on the support substrate 706.

It is a particular feature of the embodiments of FIGS. 10A-10D of thepresent disclosure that the detector assembly 700 is extremely thin,preferably under 1 mm overall. Accordingly, the support substrate 706 ispreferably 50-200 microns in thickness and the linear arrangement 708 ofdetector elements 710 is preferably 100-400 microns in thickness and thecover layer 712 is preferably 100-500 microns in thickness.

The input devices shown in FIG. 10A-10D may also include a source oflight which is preferably external to the input device, for example, asshown in FIG. 19 in a preferred embodiment of the present disclosure,the external light source is an external IR light emitting stylus, suchas stylus 322 of FIG. 2B. Suitable external light sources includesunlight, artificial room lighting and IR radiation emitted from a humanbody or other heat source. hi alternative preferred embodiments, thesource of light may comprise an illumination subassembly 716 whichtypically includes one or more electromagnetic radiation emittingsources, here shown as multiple IR emitting LEDs 718 mounted aboutinteractive surface element 704. As shown in FIGS. 10A-10D, interactivesurface element 704 is preferably associated with a display element 719,such as an LCD display. Display element 719 is preferably smaller inarea than the interactive surface element 704. The illuminationsubassembly 716 may be associated with interactive surface element 704,as described above, or may be associated with another part of theinteractive device, such as display element 719. Examples of varioussuitable configurations of illumination subassembly 716 associated withan interactive surface are described herein below in FIGS. 18A-18F, itbeing appreciated that such configurations may alternatively oradditionally be associated with a display surface or any other suitablepart of the device. Optionally, the light emitted by LEDs 718 may bemodulated by modulating circuitry (not shown).

It is a particular feature of the embodiments of FIGS. 10A-10D thatinteractive surface element 704 has a first region, overlying displayelement 719, having first user sensible functionality, and a secondregion, extending beyond display element 719, having secondfunctionality, different from the first user sensible functionality.

It is a further particular feature of the embodiments of FIGS. 10A-10Dthat both the first and second functionalities employ a common detectorassembly, such as detector assembly 700 and may employ a common sourceof light, such as illumination subassembly 716. It is appreciated thatoutput circuitry in the input devices shown in FIGS. 10A-10D maypreferably utilize the calculated X, Y coordinate data to determinewhich region of which interactive element is being selected and thusactuate the user-desired function accordingly.

It is appreciated that an interactive device, such as the devicesdescribed hereinabove with reference to FIGS. 1A-3B, may include one ormore multi-region interactive surface elements, examples of which areillustrated in FIGS. 10A-10D, and other examples of which are describedhereinabove and herein below with reference to any one or more of FIGS.4-9D and 11A-17C.

In the embodiment of FIG. 10A, cover layer 712 is formed of glass or anyother suitable light transparent material.

Reference is now made to FIG. 10B, in which it is seen that cover layer712 includes a field-of-view defining mask 720 having apertures 733formed therein in sizes and arrangements which provide desiredfields-of-view for the various corresponding detector elements 710. Eachdetector element 710 may have associated therewith a single aperture733, as shown, or a plurality of smaller apertures.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 710. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of apertures 733 and their locations with respect to anddistances from detector elements 710. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 710 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 710 to a solidangle of less than or equal to 7 degrees.

Reference is now made to FIG. 10C, which differs from that of FIG. 10Bin that apertures 733 in mask 720 are replaced by light collimatingtunnel-defining apertures 740 in a mask 742.

Each detector element 710 may have associated therewith a singletunnel-defining aperture 740, as shown, or a plurality of smallertunnel-defining apertures.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 710. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of apertures 740 and their locations with respect to anddistances from detector elements 710. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 710 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 710 to a solidangle of less than or equal to 7 degrees.

Reference is now made to FIG. 10D, which differs from that of FIGS. 10Band 10C in that the apertures in FIGS. 10B and 10C are replaced bylenses 753. Lenses 753 may be integrally formed with cover layer 712 ormay be discrete elements fitted within suitably sized and positionedapertures in cover layer 712. Lenses 753 may be associated withtunnel-defining apertures or may comprise an array of microlensesaligned with one or more of detector elements 710.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 710. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of lenses 753 and their locations with respect to anddistances from detector elements 710. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 710 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 710 to a solidangle of less than or equal to 7 degrees.

Reference is now made to FIGS. 11A, 11B, 11C and 11D, which aresimplified illustrations of four alternative embodiments of a portion ofan input device constructed and operative in accordance with a furtherpreferred embodiment of the present disclosure, employing forward-facingdetector elements arranged behind edges of a display element. hi thestructure of FIGS. 11A-11D, at least one detector assembly 800 isarranged behind at least one edge 802 of an interactive surface element804, coinciding with a viewing plane, to sense light impinging ontodetector assembly 800 after propagating through interactive surfaceelement 804. Interactive surface element 804 may be a single or multiplelayer plate and may have one or more coating layers associatedtherewith. The light, preferably including light in the IR band, isemitted by a light beam emitter, such as light beam emitting stylus 180in the embodiment of FIG. 1C or the light beam emitting remote controldevice 292 of FIG. 1F, or a light reflecting object, as in theembodiment of FIG. 1D. Preferably, detector assemblies 800 are providedbehind at least two mutually perpendicular edges 802, though detectorassemblies 800 may be provided behind all or most of edges 802.Alternatively, a single detector assembly 800 may be provided behindinteractive surface element 804 at only one edge thereof.

In accordance with a preferred embodiment of the present disclosure, thedetector assembly 800 comprises a support substrate 806 onto which ismounted a linear arrangement 808 of detector elements 810. As distinctfrom the embodiments of FIGS. 4-7, in the embodiments of FIGS. 11A-11D,the detector assembly 800 and the detector elements 810 are generallyforward facing, in the sense illustrated generally in FIG. 1B anddescribed hereinabove with respect thereto. Also, as distinct from theembodiments of FIGS. 10A-10D, the cover layer is obviated and itsfunctionality is provided by suitable conditioning of a rearward facingsurface 811 of interactive surface element 804 at the edge 802 lying infront of the linear arrangement 808. This functionality may providemultiple functions including physical protection, light intensitylimitation and field-of-view limitation, and may have optical power. Thesupport substrate 806 may be mounted onto a display housing (not shown)or may be integrally formed therewith. The support substrate 806 mayalternatively be mounted onto the rearward facing surface 811 ofinteractive surface element 804 at the edge 802. The support substrate806 may be formed of a ceramic material, a material such as FR-4 whichis commonly used for PCBs, glass, plastic or a metal such as aluminum.The support substrate may also provide mounting for and electricalconnections to the detector elements 810. A processor 814 for processingthe outputs of the detector elements 810 may also be mounted on thesupport substrate 806.

It is a particular feature of the embodiments of FIGS. 11A-11D of thepresent disclosure that the detector assembly 800 is extremely thin,preferably under 1 mm overall. Accordingly, the support substrate 806 ispreferably 50-200 microns in thickness and the linear arrangement 808 ofdetector elements 810 is preferably 100-400 microns in thickness.

The input devices shown in FIG. 11A-11D may also include a source oflight which is preferably external to the input device, for example, asshown in FIG. 19. In a preferred embodiment of the present disclosure,the external light source is an external IR light emitting stylus, suchas stylus 322 of FIG. 2B. Suitable external light sources includesunlight, artificial room lighting and IR radiation emitted from a humanbody or other heat source.

In alternative preferred embodiments, the source of light may comprisean illumination subassembly 816 which typically includes one or moreelectromagnetic radiation emitting sources, here shown as multiple IRemitting LEDs 818 mounted about interactive surface element 804. Asshown in FIGS. 11A-11D, interactive surface element 804 is preferablyassociated with a display element 819, such as an LCD display. Displayelement 819 is preferably smaller in area than the interactive surfaceelement 804.

The illumination subassembly 816 may be associated with the interactivesurface element 804, as described above, or may be associated withanother part of the interactive device, such as display element 819.Examples of various suitable configurations of illumination subassembly816 associated with an interactive surface are described herein below inFIGS. 18A-18F, it being appreciated that such configurations mayalternatively or additionally be associated with a display surface orany other suitable part of the device. Optionally, the light emitted byLEDs 818 may be modulated by modulating circuitry (not shown).

It is a particular feature of the embodiments of FIGS. 11A-11D thatinteractive surface element 804 has a first region, overlying displayelement 819, having first user sensible functionality and a secondregion, extending beyond display element 819, having secondfunctionality, different from the first user sensible functionality. Itis a further particular feature of the embodiments of FIGS. 11A-11D thatboth the first and second functionalities employ a common detectorassembly, such as detector assembly 800 and may employ a common sourceof light, such as illumination subassembly 816.

It is appreciated that output circuitry in the input devices shown inFIGS. 11A-11D may preferably utilize the calculated X, Y coordinate datato determine which region of which interactive element is being selectedand thus actuate the user-desired function accordingly.

It is appreciated that an interactive device, such as the devicesdescribed hereinabove with reference to FIGS. 1A-3B, may include one ormore multi-region interactive surface elements, examples of which areillustrated in FIGS. 11A-11D, and other examples of which are describedhereinabove and herein below with reference to any one or more of FIGS.4-10D and 12A-17C.

In the embodiment of FIG. 11A, the rearward facing surface 811 ofinteractive surface element 804 at the edge 802 lying in front of thelinear arrangement 808 is uniformly polished for unimpeded lighttransmission therethrough to linear arrangement 808 of detector elements810.

Reference is now made to FIG. 11B, in which it is seen that the rearwardfacing surface 811 of interactive surface element 804 at the edge 802lying in front of the linear arrangement 808 is conditioned to define afield-of-view defining mask 820 having apertures 833 formed therein insizes and arrangements which provide desired fields-of-view for thevarious corresponding detector elements 810. Each detector element 810may have associated therewith a single aperture 833, as shown, or aplurality of smaller apertures.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 810. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of apertures 833 and their locations with respect to anddistances from detector elements 810. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 810 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 810 to a solidangle of less than or equal to 7 degrees.

Reference is now made to FIG. 11C, which differs from that of FIG. 11Bin that apertures 833 in mask 820 are replaced by light collimatingtunnel-defining apertures 840 in a mask 842. Each detector element 810may have associated therewith a single tunnel-defining aperture 840, asshown, or a plurality of smaller tunnel-defining apertures.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 810. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of apertures 840 and their locations with respect to anddistances from detector elements 810. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 810 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 810 to a solidangle of less than or equal to 7 degrees.

Reference is now made to FIG. 11D, which differs from that of FIGS. 11Band 11C in that the apertures in FIGS. 11B and 11C are replaced bylenses 853. Lenses 853 may be integrally formed at edges 802 or may bediscrete elements fitted within suitably sized and positioned aperturesin interactive surface element 804. Lenses 853 may be associated withtunnel-defining apertures or may comprise an array of microlensesaligned with one or more of detector elements 810.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 810. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of lenses 853 and their locations with respect to anddistances from detector elements 810. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 810 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 810 to a solidangle of less than or equal to 7 degrees.

Reference is now made to FIGS. 12A, 12B, 12C and 12D, which aresimplified illustrations of four alternative embodiments of a portion ofan input device constructed and operative in accordance with a yetfurther preferred embodiment of the present disclosure, employingdetector elements arranged along edges of a display element.

In the structure of FIGS. 12A-12D, at least one detector assembly 900 isarranged along at least one edge 902 of an interactive surface element904, coinciding with a viewing plane, to sense light impinging oninteractive surface element 904 and propagating within the interactivesurface element to the edges 902 thereof. Interactive surface element904 may be a single or multiple layer plate and may have one or morecoating layers associated therewith. Preferably, detector assemblies 900are provided along at least two mutually perpendicular edges 902, thoughdetector assemblies 900 may be provided along all or most of edges 902.Alternatively, a single detector assembly 900 may be provided along onlyone edge 902 of interactive surface element 904.

The detector assembly 900 includes a linear arrangement 908 of detectorelements 910. As distinct from the embodiments of FIGS. 8A-8D, thedetector assembly 900 does not comprise a support substrate onto whichis mounted a linear arrangement of detector elements. In the embodimentsof FIGS. 12A-12D, the support substrate of FIGS. 8A-8D is replaced by aportion of a peripheral housing 912. Similarly to the embodiments ofFIGS. 4-7 there is provided a cover layer 914 which provides multiplefunctions including physical protection, light intensity limitation andfield-of-view limitation, and may have optical power. Alternatively,cover layer 914 may be obviated.

The peripheral housing 912 may be formed of any suitable materialincluding, for example, ceramic material, a material such as FR-4 whichis commonly used for PCBs, glass, plastic or a metal such as aluminum.The peripheral housing 912 may also provide mounting for and electricalconnections to the detector elements 910.

A processor 916 for processing the outputs of the detector elements 910may also be mounted on the peripheral housing 912.

It is a particular feature of this embodiment of the present disclosurethat the detector assembly 900 is extremely thin, preferably under 1 mmoverall. Accordingly, the linear arrangement 908 of detector elements910 is preferably 100-400 microns in thickness.

The input devices shown in FIG. 12A-12D may also include a source oflight which is preferably external to the input device, for example, asshown in FIG. 19.

In a preferred embodiment of the present disclosure, the external lightsource is an external IR light emitting stylus, such as stylus 322 ofFIG. 2B. Suitable external light sources include sunlight, artificialroom lighting and IR radiation emitted from a human body or other heatsource.

In an alternate preferred embodiment, the source of light may comprisean illumination subassembly 917 which typically includes one or moreelectromagnetic radiation emitting sources, here shown as multiple IRemitting LEDs 918 mounted about an interactive surface element 904. Asshown in FIGS. 12A-12D, interactive surface element 904 is preferablyassociated with a display element 919, such as an LCD display. Displayelement 919 is preferably smaller in area than the interactive surfaceelement 904. The illumination subassembly 917 may be associated withinteractive surface element 904, as described above, or may beassociated with another part of the interactive device, such as displayelement 919. Examples of various suitable configurations of illuminationsubassembly 917 associated with an interactive surface are describedherein below in FIGS. 18A-18F, it being appreciated that suchconfigurations may alternatively or additionally be associated with adisplay surface or any other suitable part of the device. Optionally,the light emitted by LEDs 918 may be modulated by modulating circuitry(not shown).

It is a particular feature of the embodiment of FIGS. 12A-12D thatinteractive surface element 904 has a first region, overlying displayelement 919, having first user sensible functionality and a secondregion, extending beyond display element 919, having secondfunctionality, different from the first user sensible functionality.

It is a further particular feature of the embodiments of FIGS. 12A-12Dthat both the first and second functionalities employ a common detectorassembly, such as detector assembly 900, and may employ a common sourceof light, such as illumination subassembly 917. It is appreciated thatoutput circuitry in the input devices shown in FIGS. 12A-12D maypreferably utilize the calculated X, Y coordinate data to determinewhich region of which interactive element is being selected and thusactuate the user-desired function accordingly.

It is appreciated that an interactive device, such as the devicesdescribed hereinabove with reference to FIGS. 1A-3B, may include one ormore multi-region interactive surface elements, examples of which areillustrated in FIGS. 12A-12D, and other examples of which are describedhereinabove and herein below with reference to any one or more of FIGS.4-11D and 13A-17C.

In the embodiment of FIG. 12A, cover layer 914 provides generallyunimpeded light transmission therethrough to linear arrangement 908 ofdetector elements 910.

Reference is now made to FIG. 12B, in which it is seen that cover layer914 defines a field-of-view defining mask 920 having apertures 933formed therein in sizes and arrangements which provide desiredfields-of-view for the various corresponding detector elements 910. Eachdetector element 910 may have associated therewith a single aperture933, as shown, or a plurality of smaller apertures.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 910. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of apertures 933 and their locations with respect to anddistances from detector elements 910. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 910 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 910 to a solidangle of less than or equal to 7 degrees.

Reference is now made to FIG. 12C, which differs from that of FIG. 12Bin that apertures 933 in mask 920 are replaced by light collimatingtunnel-defining apertures 940 in a mask 942.

Each detector element 910 may have associated therewith a singletunnel-defining aperture 940, as shown, or a plurality of smallertunnel-defining apertures.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 910. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of apertures 940 and their locations with respect to anddistances from detector elements 910. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 910 to a solid angleof less than or equal to 15 degrees, in accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 910 to a solidangle of less than or equal to 7 degrees.

Reference is now made to FIG. 12D, which differs from that of FIGS. 12Band 12C in that the apertures in FIGS. 12B and 12C are replaced bylenses 953. Lenses 953 may be integrally formed at edges 902 or may bediscrete elements fitted within suitably sized and positioned aperturesin interactive surface element 904. Lenses 953 may be associated withtunnel-defining apertures or may comprise an array of microlensesaligned with one or more of detector elements 910.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 910. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of lenses 953 and their locations with respect to anddistances from detector elements 910. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 910 to a solid angleof less than or equal to 15 degrees, in accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 910 to a solidangle of less than or equal to 7 degrees.

Reference is now made to FIGS. 13A, 13B, 13C and 13D, which aresimplified illustrations of four alternative embodiments of a portion ofan input device constructed and operative in accordance with a stillfurther preferred embodiment of the present disclosure, employingdetector elements arranged along edges of a display element.

In the structure of FIGS. 13A-13D, at least one detector assembly 960 isarranged along at least one edge 962 of an interactive surface element964, coinciding with a viewing plane, to sense light impinging oninteractive surface element 964 and propagating within interactivesurface element 964 to the edges 962 thereof. Interactive surfaceelement 964 may be a single or multiple layer plate and may have one ormore coating layers associated therewith. Preferably, detectorassemblies 960 are provided along at least two mutually perpendicularedges 962, though detector assemblies 960 may be provided along all ormost of edges 962. Alternatively, a single detector assembly 960 may beprovided along only one edge 962 of interactive surface element 964.

The detector assembly 960 includes a linear arrangement 968 of detectorelements 970. As distinct from the embodiments of FIGS. 12A-12D, in theembodiments of FIGS. 13A-13D, the cover layer is obviated and itsfunctionality is provided by suitable conditioning of edge 962 ofinteractive surface element 964. This functionality may provide multiplefunctions including physical protection, light intensity limitation andfield-of-view limitation, and may have optical power.

As in the embodiments of FIGS. 12A-12D, detector assembly 960 does notcomprise a support substrate onto which is mounted a linear arrangementof detector elements. In the embodiments of FIGS. 13A-13D, the supportsubstrate of FIGS. 8A-8D is replaced by a portion of a peripheralhousing 972.

The peripheral housing 972 may be formed of any suitable materialincluding, for example, ceramic material, a material such as FR-4 whichis commonly used for PCBs, glass, plastic or a metal such as aluminum.The peripheral housing 972 may also provide mounting for and electricalconnections to the detector elements 970.—A processor 976 for processingthe outputs of the detector elements 970 may also be mounted on theperipheral housing 972.

It is a particular feature of this embodiment of the present disclosurethat the detector assembly 960 is extremely thin, preferably under 1 mmoverall. Accordingly, the linear arrangement 968 of detector elements970 is preferably 100-400 microns in thickness. The input devices shownin FIG. 13A-13D may also include a source of light which is preferablyexternal to the input device, for example, as shown in FIG. 19. In apreferred embodiment of the present disclosure, the external lightsource is an external IR light emitting stylus, such as stylus 322 ofFIG. 2B. Suitable external light sources include sunlight, artificialroom lighting and IR radiation emitted from a human body or other heatsource.

In an alternate preferred embodiment, the source of light may comprisean illumination subassembly 977 which typically includes one or moreelectromagnetic radiation emitting sources, here shown as multiple IRemitting LEDs 978 mounted about interactive surface element 964. Asshown in FIGS. 13A-13D, interactive surface element 964 is preferablyassociated with a display element 979, such as an LCD display. Displayelement 979 is preferably smaller in area than the interactive surfaceelement 964.

The illumination subassembly 977 may be associated with interactivesurface element 964, as described above, or may be associated withanother part of the interactive device, such as display element 979.Examples of various suitable configurations of illumination subassembly977 associated with an interactive surface are described herein below inFIGS. 18A-18F, it being appreciated that such configurations mayalternatively or additionally be associated with a display surface orany other suitable part of the device. Optionally, the light emitted byLEDs 978 may be modulated by modulating circuitry (not shown).

It is a particular feature of the embodiment of FIGS. 13A-13D thatinteractive surface element 964 has a first region, overlying displayelement 979, having first user sensible functionality and a secondregion, extending beyond display element 979, having secondfunctionality, different from the first user sensible functionality. Itis a further particular feature of the embodiments of FIGS. 13A-13D thatboth the first and second functionalities employ a common detectorassembly, such as detector assembly 960 and may employ a common sourceof light, such as illumination subassembly 977.

It is appreciated that output circuitry in the input devices shown inFIGS. 13A-13D may preferably utilize the calculated X, Y coordinate datato determine which region of which interactive element is being selectedand thus actuate the user-desired function accordingly.

It is appreciated that an interactive device, such as the devicesdescribed hereinabove with reference to FIGS. 1A-3B, may include one ormore multi-region interactive surface elements, examples of which areillustrated in FIGS. 13A-13D, and other examples of which are describedhereinabove and herein below with reference to any one or more of FIGS.4-12D and 14A-17C in the embodiment of FIG. 13A, edge 962 is uniformlypolished for unimpeded light transmission therethrough to lineararrangement 968 of detector elements 970. Reference is now made to FIG.13B, in which it is seen that edge 962 is conditioned to define afield-of-view defining mask 980 having apertures 983 formed therein insizes and arrangements which provide desired fields-of-view for thevarious corresponding detector elements 970. Each detector element 970may have associated therewith a single aperture 983, as shown, or aplurality of smaller apertures. Field-of-view limiting functionality maybe desirable in this context because it enhances resolution by limitingoverlap between the fields-of-view of adjacent detector elements 970.Extent of field-of-view limiting may be controlled by the size, pitchand arrangement of apertures 983 and their locations with respect to anddistances from detector elements 970. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 970 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 970 to a solidangle of less than or equal to 7 degrees. Reference is now made to FIG.13C, which differs from that of FIG. 13B in that apertures 983 in mask980 are replaced by light collimating tunnel-defining apertures 990 in amask 992.

Each detector element 970 may have associated therewith a singletunnel-defining aperture 990, as shown, or a plurality of smallertunnel-defining apertures.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 970. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of apertures 990 and their locations with respect to anddistances from detector elements 970. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 970 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 970 to a solidangle of less than or equal to 7 degrees.

Reference is now made to FIG. 13D, which differs from FIGS. 13B and 13Cin that the apertures in FIGS. 13B and 13C are replaced by lenses 993.Lenses 993 may be integrally formed at edges 962 or may be discreteelements fitted within suitably sized and positioned apertures ininteractive surface element 964. Lenses 993 may be associated withtunnel-defining apertures or may comprise an array of microlensesaligned with one or more of detector elements 970.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 970. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of lenses 993 and their locations with respect to anddistances from detector elements 970. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 970 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 970 to a solidangle of less than or equal to 7 degrees.

Reference is now made to FIGS. 14A, 14B, 14C and 14D, which aresimplified illustrations of four alternative embodiments of a portion ofan input device constructed and operative in accordance with anadditional preferred embodiment of the present disclosure, employingforward-facing detector elements arranged about edges of a displayelement.

In the structure of FIGS. 14A-14D, at least one detector assembly 1000is arranged about at least one edge 1002 of an interactive surfaceelement 1004, coinciding with a viewing plane, to sense light impingingdirectly onto detector assembly 1000. Interactive surface element 1004may be a single or multiple layer plate and may have one or more coatinglayers associated therewith. The light, preferably including light inthe IR band, is emitted by a light beam emitter, such as light beamemitting remote control device 180 in the embodiment of FIG. 1C or thelight beam emitting remote control device 292 of FIG. 1F, or a lightreflecting object, as in the embodiment of FIG. 1D. Preferably, detectorassemblies 1000 are provided along at least two mutually perpendicularedges 1002, though detector assemblies 1000 may be provided along all ormost of edges 1002. Alternatively, a single detector assembly 1000 maybe provided along only one edge 1002 of interactive surface element1004. The detector assembly 1000 includes a linear arrangement 1008 ofdetector elements 1010. As distinct from the embodiments of FIGS. 9A-9D,the detector assembly 1000 does not comprise a support substrate ontowhich is mounted a linear arrangement of detector elements. In theembodiments of FIGS. 14A-14D, the support substrate of FIGS. 9A-9D isreplaced by a portion of a peripheral housing 1012. Similarly to theembodiments of FIGS. 9A-9D there is provided a cover layer 1014 whichprovides multiple functions including physical protection, lightintensity limitation and field-of-view limitation, and may have opticalpower. Alternatively, cover layer 1014 may be obviated.

The peripheral housing 1012 may be formed of any suitable materialincluding, for example, ceramic material, a material such as FR-4 whichis commonly used for PCBs, glass, plastic or a metal such as aluminum.The peripheral housing 1012 may also provide mounting for and electricalconnections to the detector elements 1010. A processor 1016 forprocessing the outputs of the detector elements 1010 may also be mountedon the peripheral housing 1012. It is a particular feature of thisembodiment of the present disclosure that the detector assembly 1000 isextremely thin, preferably under 1 mm overall. Accordingly, the lineararrangement 1008 of detector elements 1010 is preferably 100-400 micronsin thickness and the cover layer 1014 is preferably 100-500 microns inthickness.

The input devices shown in FIG. 14A-14D may also include a source oflight which is preferably external to the input device, for example, asshown in FIG. 19. In a preferred embodiment of the present disclosure,the external light source is an external IR light emitting stylus, suchas stylus 322 of FIG. 2B. Suitable external light sources includesunlight, artificial room lighting and IR radiation emitted from a humanbody or other heat source.

In an alternate preferred embodiment, the source of light may comprisean illumination subassembly 1017 which typically includes one or moreelectromagnetic radiation emitting sources, here shown as multiple IRemitting LEDs 1018 mounted about interactive surface element 1004. Asshown in FIGS. 14A-14D, interactive surface element is preferablyassociated with a display element 1019, such as an LCD display. Displayelement 1019 is preferably smaller in area than the interactive surfaceelement 1004.

The illumination subassembly 1017 may be associated with interactivesurface element 1004, as described above, or may be associated withanother part of the interactive device, such as display element 1019.Examples of various suitable configurations of illumination subassembly1017 associated with an interactive surface are described herein belowin FIGS. 18A-18F, it being appreciated that such configurations mayalternatively or additionally be associated with a display surface orany other suitable part of the device. Optionally, the light emitted byLEDs 1018 may be modulated by modulating circuitry (not shown).

It is a particular feature of the embodiment of FIGS. 14A-14D thatinteractive surface element 1004 has a first region, overlying displayelement 1019, having first user sensible functionality and a secondregion, extending beyond display element 1019, having secondfunctionality, different from the first user sensible functionality.

It is a further particular feature of the embodiments of FIGS. 14A-14Dthat both the first and second functionalities employ a common detectorassembly, such as detector assembly 1000, and may employ a common sourceof light, such as illumination subassembly 1017.

It is appreciated that output circuitry in the input devices shown inFIGS. 14A-14D may preferably utilize the calculated X, Y coordinate datato determine which region of which interactive element is being selectedand thus actuate the user-desired function accordingly. It isappreciated that an interactive device, such as the devices describedhereinabove with reference to FIGS. 1A-3B, may include one or moremulti-region interactive surface elements, examples of which areillustrated in FIGS. 14A-14D, and other examples of which are describedhereinabove and herein below with reference to any one or more of FIGS.4-13D and 15A-17C. In the embodiment of FIG. 14A, cover layer 1014 isformed of glass or any other suitable light transparent material.

Reference is now made to FIG. 14B, in which it is seen that cover layer1014 includes a field-of-view defining mask 1020 having apertures 1033formed therein in sizes and arrangements which provide desiredfields-of-view for the various corresponding detector elements 1010.Each detector element 1010 may have associated therewith a singleaperture 1033, as shown, or a plurality of smaller apertures.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 1010. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of apertures 1033 and their locations with respect to anddistances from detector elements 1010. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 1010 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 1010 to a solidangle of less than or equal to 7 degrees.

Reference is now made to FIG. 14C, which differs from that of FIG. 14Bin that apertures 1033 in mask 1020 are replaced by light collimatingtunnel-defining apertures 1040 in a mask 1042. Each detector element1010 may have associated therewith a single tunnel-defining aperture1040, as shown, or a plurality of smaller tunnel-defining apertures.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 1010. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of apertures 1040 and their locations with respect to anddistances from detector elements 1010. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 1010 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 1010 to a solidangle of less than or equal to 7 degrees.

Reference is now made to FIG. 14D, which differs from that of FIGS. 14Band 14C in that the apertures in FIGS. 14B and 14C are replaced bylenses 1053. Lenses 1053 may be integrally formed with cover layer 1014or may be discrete elements fitted within suitably sized and positionedapertures in cover layer 1014. Lenses 1053 may be associated withtunnel-defining apertures or may comprise an array of microlensesaligned with one or more of detector elements 1010.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 1010. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of lenses 1053 and their locations with respect to anddistances from detector elements 1010. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 1010 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 1010 to a solidangle of less than or equal to 7 degrees.

Reference is now made to FIGS. 15A, 15B, 15C and 15D, which aresimplified illustrations of four alternative embodiments of a portion ofan input device constructed and operative in accordance with anotherpreferred embodiment of the present disclosure, employing forward-facingdetector elements arranged behind edges of a display element.

In the structure of FIGS. 15A-15D, at least one detector assembly 1060is arranged behind at least one edge 1062 of an interactive surfaceelement 1064, coinciding with a viewing plane, to sense light impingingonto detector assembly 1060 after propagating through interactivesurface element 1064. Interactive surface element 1064 may be a singleor multiple layer plate and may have one or more coating layersassociated therewith. The light, preferably including light in the IRband, is emitted by a light beam emitter, such as light beam emittingstylus 180 in the embodiment of FIG. 1C or the light beam emittingremote control device 292 of FIG. 1F, or a light reflecting object, asin the embodiment of FIG. 1D. Preferably, detector assemblies 1060 areprovided behind at least two mutually perpendicular edges 1062, thoughdetector assemblies 1060 may be provided behind all or most of edges1062. Alternatively, a single detector assembly 1060 may be providedbehind only one of edges 1062.

The detector assembly 1060 includes a linear arrangement 1068 ofdetector elements 1070. As distinct from the embodiments of FIGS.10A-10D, the detector assembly 1060 does not comprise a supportsubstrate onto which is mounted a linear arrangement of detectorelements. In the embodiments of FIGS. 15A-15D, the support substrate ofFIGS. 10A-10D is replaced by a portion of a peripheral housing 1072.Similarly to the embodiments of FIGS. 10A-10D there is provided a coverlayer 1074 which provides multiple functions including physicalprotection, light intensity limitation and field-of-view limitation, andmay have optical power. Alternatively, cover layer 1074 may be obviated.

The peripheral housing 1072 may be formed of any suitable materialincluding, for example, ceramic material, a material such as FR-4 whichis commonly used for PCBs, glass, plastic or a metal such as aluminum.The peripheral housing 1072 may also provide mounting for and electricalconnections to the detector elements 1070. A processor 1076 forprocessing the outputs of the detector elements 1070 may also be mountedon the peripheral housing 1072.

It is a particular feature of this embodiment of the present disclosurethat the detector assembly 1060 is extremely thin, preferably under 1 mmoverall. Accordingly, the linear arrangement 1068 of detector elements1070 is preferably 100-400 microns in thickness and the cover layer 1074is preferably 100-500 microns in thickness.

The input devices shown in FIG. 15A-15D may also include a source oflight which is preferably external to the input device, for example, asshown in FIG. 19. In a preferred embodiment of the present disclosure,the external light source is an external IR light emitting stylus, suchas stylus 322 of FIG. 2B. Suitable external light sources includesunlight, artificial room lighting and IR radiation emitted from a humanbody or other heat source.

In an alternate preferred embodiment, the source of light may comprisean illumination subassembly 1077 which typically includes one or moreelectromagnetic radiation emitting sources, here shown as multiple IRemitting LEDs 1078 mounted about interactive surface element 1064. Asshown in FIGS. 15A-15D, interactive surface element 1064 is preferablyassociated with a display element 1079, such as an LCD display. Displayelement 1079 is preferably smaller in area than the interactive surfaceelement 1064.

The illumination subassembly 1077 may be associated with interactivesurface element 1064, as described above, or may be associated withanother part of the interactive device, such as display element 1079.Examples of various suitable configurations of illumination subassembly1077 associated with an interactive surface are described herein belowin FIGS. 18A-18F, it being appreciated that such configurations mayalternatively or additionally be associated with a display surface orany other suitable part of the device. Optionally, the light emitted byLEDs 1078 may be modulated by modulating circuitry (not shown).

It is a particular feature of the embodiments of FIGS. 15A-15D thatinteractive surface element 1064 has a first region, overlying displayelement 1079, having first user sensible functionality and a secondregion, extending beyond display element 1079, having secondfunctionality, different from the first user sensible functionality.

It is a further particular feature of the embodiments of FIGS. 15A-15Dthat both the first and second functionalities employ a common detectorassembly, such as detector assembly 1060, and may employ a common sourceof light, such as illumination subassembly 1077.

It is appreciated that output circuitry in the input devices shown inFIGS. 15A-15D may preferably utilize the calculated X, Y coordinate datato determine which region of which interactive element is being selectedand thus actuate the user-desired function accordingly.

It is appreciated that an interactive device, such as the devicesdescribed hereinabove with reference to FIGS. 1A-3B, may include one ormore multi-region interactive surface elements, examples of which areillustrated in FIGS. 15A-15D, and other examples of which are describedhereinabove and herein below with reference to any one or more of FIGS.4-14D and 16A-17C.

In the embodiment of FIG. 15A, cover layer 1074 is formed of glass orany other suitable light transparent material. Reference is now made toFIG. 15B, in which it is seen that cover layer 1074 includes afield-of-view defining mask 1080 having apertures 1083 formed therein insizes and arrangements which provide desired fields-of-view for thevarious corresponding detector elements 1070. Each detector element 1070may have associated therewith a single aperture 1083, as shown, or aplurality of smaller apertures. Field-of-view limiting functionality maybe desirable in this context because it enhances resolution by limitingoverlap between the fields-of-view of adjacent detector elements 1070.Extent of field-of-view limiting may be controlled by the size, pitchand arrangement of apertures 1083 and their locations with respect toand distances from detector elements 1070. In accordance with apreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 1070 to a solidangle of less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 1070 to a solidangle of less than or equal to 7 degrees. Reference is now made to FIG.15C, which differs from that of FIG. 15B in that apertures 1083 in mask1080 are replaced by light collimating tunnel-defining apertures 1090 ina mask 1092.

Each detector element 1070 may have associated therewith a singletunnel-defining aperture 1090, as shown, or a plurality of smallertunnel-defining apertures.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 1070. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of apertures 1090 and their locations with respect to anddistances from detector elements 1070. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 1070 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 1070 to a solidangle of less than or equal to 7 degrees.

Reference is now made to FIG. 15D, which differs from that of FIGS. 15Band 15C in that the apertures in FIGS. 15B and 15C are replaced bylenses 1093. Lenses 1093 may be integrally formed with cover layer 1074or may be discrete elements fitted within suitably sized and positionedapertures in cover layer 1074. Lenses 1093 may be associated withtunnel-defining apertures or may comprise an array of microlensesaligned with one or more of detector elements 1070. Field-of-viewlimiting functionality may be desirable in this context because itenhances resolution by limiting overlap between the fields-of-view ofadjacent detector elements 1070. Extent of field-of-view limiting may becontrolled by the size, pitch and arrangement of lenses 1093 and theirlocations with respect to and distances from detector elements 1070. Inaccordance with a preferred embodiment, the field-of-view limitingfunctionality limits the field-of-view of at least one of detectorelements 1070 to a solid angle of less than or equal to 15 degrees. Inaccordance with another preferred embodiment, the field-of-view limitingfunctionality limits the field-of-view of at least one of detectorelements 1070 to a solid angle of less than or equal to 7 degrees.Reference is now made to FIGS. 16A, 16B, 16C and 16D, which aresimplified illustrations of four alternative embodiments of a portion ofan input device constructed and operative in accordance with yet anotherpreferred embodiment of the present disclosure, employing forward-facingdetector elements arranged behind edges of a display element. In thestructure of FIGS. 16A-16D, at least one detector assembly 1100 isarranged behind at least one edge 1102 of an interactive surface element1104, coinciding with a viewing plane, to sense light impinging oninteractive surface element 1104 and propagating within interactivesurface element 1104 to the edges 1102 thereof. Interactive surfaceelement 1104 may be a single or multiple layer interactive surfaceelement and may have one or more coating layers associated therewith.Preferably, detector assemblies 1100 are provided behind at least twomutually perpendicular edges 1102, though detector assemblies 1100 maybe provided behind all or most of edges 1102. Alternatively, a singledetector assembly 1100 may be provided behind interactive surfaceelement 1104 at only one edge thereof.

The detector assembly 1100 includes a linear arrangement 1108 ofdetector elements 1110. As distinct from the embodiments of FIGS.15A-15D, in the embodiments of FIGS. 16A-16D, the cover layer isobviated and its functionality is provided by suitable conditioning ofedge 1102 of interactive surface element 1104. This functionality mayprovide multiple functions including physical protection, lightintensity limitation and field-of-view limitation, and may have opticalpower.

As in the embodiment of FIGS. 15A-15D, detector assembly 1100 does notcomprise a support substrate onto which is mounted a linear arrangementof detector elements. In the embodiments of FIGS. 16A-16D, the supportsubstrate of FIGS. 11A-11D is replaced by a portion of a peripheralhousing 1112.

The peripheral housing 1112 may be formed of any suitable materialincluding, for example, ceramic material, a material such as FR-4 whichis commonly used for PCBs, glass, plastic or a metal such as aluminum.The peripheral housing 1112 may also provide mounting for and electricalconnections to the detector elements 1110. A processor 1116 forprocessing the outputs of the detector elements 1110 may also be mountedon the peripheral housing 1112.

It is a particular feature of this embodiment of the present disclosurethat the detector assembly 1100 is extremely thin, preferably under 1 mmoverall. Accordingly, the linear arrangement 1108 of detector elements1110 is preferably 100-400 microns in thickness.

The input devices shown in FIG. 16A-16D may also include a source oflight which is preferably external to the input device, for example, asshown in FIG. 19. In a preferred embodiment of the present disclosure,the external light source is an external IR light emitting stylus, suchas stylus 322 of FIG. 2B. Suitable external light sources includesunlight, artificial room lighting and IR radiation emitted from a humanbody or other heat source.

In an alternate preferred embodiment, the source of light may comprisean illumination subassembly 1117 which typically includes one or moreelectromagnetic radiation emitting sources, here shown as multiple IRemitting LEDs 1118 mounted about interactive surface element 1104. Asshown in FIGS. 16A-16D, interactive surface element 1104 is preferablyassociated with a display element 1119, such as an LCD display. Displayelement 1119 is preferably smaller in area than the interactive surfaceelement 1104. The illumination subassembly 1117 may be associated withthe interactive surface element 1104, as described above, or may beassociated with another part of the interactive device, such as displayelement 1119. Examples of various suitable configurations ofillumination subassembly 1117 associated with an interactive surface aredescribed herein below in FIGS. 18A-18F, it being appreciated that suchconfigurations may alternatively or additionally be associated with adisplay surface or any other suitable part of the device. Optionally,the light emitted by LEDs 1118 may be modulated by modulating circuitry(not shown).

It is a particular feature of the embodiment of FIGS. 16A-16D thatinteractive surface element 1104 has a first region, overlying displayelement 1119, having first user sensible functionality and a secondregion, extending beyond display element 1119, having secondfunctionality, different from the first user sensible functionality.

It is a further particular feature of the embodiments of FIGS. 16A-16Dthat both the first and second functionalities employ a common detectorassembly, such as detector assembly 1100, and may employ a common sourceof light, such as illumination subassembly 1117.

It is appreciated that output circuitry in the input devices shown inFIGS. 16A-16D may preferably utilize the calculated X, Y coordinate datato determine which region of which interactive element is being selectedand thus actuate the user-desired function accordingly.

It is appreciated that an interactive device, such as the devicesdescribed hereinabove with reference to FIGS. 1A-3B, may include one ormore multi-region interactive surface elements, examples of which areillustrated in FIGS. 16A-16D, and other examples of which are describedhereinabove and herein below with reference to any one or more of FIGS.4-15D and 17A-17C.

In the embodiment of FIG. 16A, a rearward facing surface 1120 ofinteractive surface element 1104 at the edge 1102 lying in front of thelinear arrangement 1108 is uniformly polished for unimpeded lighttransmission therethrough to linear arrangement 1108 of detectorelements 1110.

Reference is now made to FIG. 16B, in which it is seen that the rearwardfacing surface 1120 of interactive surface element 1104 at the edge 1102lying in front of the linear arrangement 1108 is conditioned to define afield-of-view defining mask 1122 having apertures 1133 formed therein insizes and arrangements which provide desired fields-of-view for thevarious corresponding detector elements 1110. Each detector element 1110may have associated therewith a single aperture 1133, as shown, or aplurality of smaller apertures. Field-of-view limiting functionality maybe desirable in this context because it enhances resolution by limitingoverlap between the fields-of-view of adjacent detector elements 1110.Extent of field-of-view limiting may be controlled by the size, pitchand arrangement of apertures 1133 and their locations with respect toand distances from detector elements 1110. In accordance with apreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 1110 to a solidangle of less than or equal to 15 degrees, in accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 1110 to a solidangle of less than or equal to 7 degrees. Reference is now made to FIG.16C, which differs from that of FIG. 16B in that apertures 1133 in mask1122 are replaced by light collimating tunnel-defining apertures 1140 ina mask 1142.

Each detector element 1110 may have associated therewith a singletunnel-defining aperture 1140, as shown, or a plurality of smallertunnel-defining apertures.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 1110. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of apertures 1140 and their locations with respect to anddistances from detector elements 1110. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 1110 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 1110 to a solidangle of less than or equal to 7 degrees.

Reference is now made to FIG. 16D, which differs from that of FIGS. 16Band 16C in that the apertures in FIGS. 16B and 16C are replaced bylenses 1153. Lenses 1153 may be integrally formed at edges 1102 or maybe discrete elements fitted within suitably sized and positionedapertures in interactive surface element 1104. Lenses 1153 may beassociated with tunnel-defining apertures or may comprise an array ofmicrolenses aligned with one or more of detector elements 1110.Field-of-view limiting functionality may be desirable in this contextbecause it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 1110. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of lenses 1153 and their locations with respect to anddistances from detector elements 1110. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 1110 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 1110 to a solidangle of less than or equal to 7 degrees. Reference is now made to FIGS.17A, 17B and 17C, which are simplified illustration of three alternativeembodiments of a detector assembly forming part of an interactiveassembly constructed and operative in accordance with a preferredembodiment of the present disclosure.

In the structure of FIGS. 17A-17C, at least one detector assembly isarranged about at least one edge (not shown) of an interactive surfaceelement coinciding with a viewing plane (not shown). The detectorassemblies of FIGS. 17A-17C may be employed in any of the embodiments ofthe present disclosure described hereinabove and illustrated in FIGS.1A-16D. Preferably, detector assemblies are provided along at least twomutually perpendicular edges of the plate, though detector assembliesmay be provided along all or most of the edges. Alternatively, a singledetector assembly may be provided along only one edge of the plate. Inaccordance with a preferred embodiment of the present disclosure, thedetector assembly comprises a support substrate onto which is mounted alinear arrangement of detector elements. Preferably, a cover layer isplaced over the arrangement of detector elements and may providemultiple functions including physical protection, light intensitylimitation and field-of-view limitation, and may have optical power.Alternatively, the cover layer may be obviated.

The support substrate may be mounted onto a display housing (not shown)or may be integrally formed therewith. The support substrate mayalternatively be mounted onto an edge of the plate. The supportsubstrate may be formed of a ceramic material, a material such as FR-4which is commonly used for PCBs, glass, plastic or a metal such asaluminum. The support substrate may also provide mounting for andelectrical connections to the detector elements. A processor forprocessing the outputs of the detector elements may also be mounted onthe support substrate.

It is a particular feature of this embodiment of the present disclosurethat the detector assembly is extremely thin, preferably under 1 mmoverall. Accordingly, the support substrate is preferably 50-200 micronsin thickness and the linear arrangement of detector elements ispreferably 100-400 microns in thickness and the cover layer ispreferably 100-500 microns in thickness.

In the embodiment of FIG. 17A, the detector assembly, here designated byreference numeral 1160, includes an integrally formed multi-elementdetector array 1162. The detector array 1162 is preferably mounted ontoa support substrate 1164 and overlaid with a cover layer 1166.

In the embodiment of FIG. 17B, the detector assembly, here designated byreference numeral 1170, includes a plurality of discrete single-elementdetector elements 1172, such as Solderable Silicon Photodiodescommercially available from Advanced Photonix Incorporated of Camarillo,Calif., USA under catalog designator PDB-C601-1. The discrete detectorelements 1172 are preferably mounted onto a support substrate 1174 andoverlaid with a cover layer 1176.

In the embodiment of FIG. 17C, the detector assembly, here designated byreference numeral 1180, includes a plurality of discrete multi-elementdetector elements 1182. The discrete multi-element detector elements1182 need not be all of the same size and are preferably all mountedonto a support substrate 1184 and overlaid with a cover layer 1186.

Reference is now made to FIGS. 18A, 18B, 18C, 18D, 18E and 18F, whichare simplified illustrations of six alternative embodiments of anillumination subassembly forming part of an interactive assemblyconstructed and operative in accordance with preferred embodiments ofthe present disclosure. Alternatively or additionally, a touchresponsive input functionality and/or a propinquity responsive inputfunctionality and/or a distance responsive functionality may preferablybe operative to detect the position of a stylus (not shown) or any othersuitable reflective object.

FIGS. 18A-18F show an interactive assembly having touch responsive inputfunctionality, which is useful for application selection and operation,such as email communication and Internet surfing. The inputfunctionality may incorporate any one or more features of assignee'sU.S. Provisional Patent Application Nos. 60/715,546; 60/734,027;60/789,188 and 60/682,604, U.S. Patent Application Publication No.2005/0156914A1 and PCT Patent Application Publication No. WO2005/094176, the disclosures of which are hereby incorporated byreference.

FIGS. 18A-18F illustrate object detection functionality of the typedescribed hereinabove with reference to FIGS. 1A to 1F. As shown, aposition of a user's finger is detected by means of a touch responsiveinput functionality operative in accordance with preferred embodimentsof the present disclosure. Turning specifically to FIG. 18A, it is seenthat arrays 1202 of light detector elements 1204 are arranged at leasttwo mutually perpendicular edges 1206 of an interactive surface element1208, preferably associated with a display element 1209, such as an LCDdisplay. Interactive surface element 1208 may wholly or partiallycoincide with a viewing plane which overlies display element 1209.Display element 1209 is preferably smaller in area than the interactivesurface element 1208.

Alternatively, detector arrays 1202 may be provided along all or most ofthe edges 1206. As a further alternative, a single detector array 1202may be provided along only one edge 1206 of the interactive surfaceelement 1208. Interactive surface element 1208 may be a single ormultiple layer plate and may have one or more coating layers associatedtherewith.

It is appreciated that the phrase “at edges” is to be interpretedbroadly as including structures which are located behind edges, as inthe embodiments shown in

FIGS. 10A-10D, 11A-11D, 15A-15D and 16A-16D, about edges as in theembodiments shown in FIGS. 9A-9D and 14A-14D, and along edges as in theembodiments shown in FIGS. 4-7, 8A-8D, 12A-12D and 13A-13D.

Suitable detector elements are, for example, Solderable SiliconPhotodiodes commercially available from Advanced Photonix Incorporatedof Camarillo, Calif., USA under catalog designator PDB-C601-1.

The interactive assembly shown in FIG. 18A preferably includes anillumination subassembly 1212 which typically includes one or moreelectromagnetic radiation emitting sources. The illumination subassembly1212 may provide a baseline illumination level which is typicallydetected by detector elements 1204. The structure and location of theillumination subassembly are preferably selected to provide a desiredbaseline illumination level or to minimize the baseline illuminationlevel.

In accordance with a preferred embodiment of the present disclosure,shown in FIG. 18 A, a single IR emitting LED 1216 is provided at orgenerally adjacent to an intersection of the mutually perpendicularedges 1206 along which detector elements 1204 are arranged. The LED 1216is arranged such that light emitted therefrom is projected generallyacross the surface of interactive surface element 1208. It isappreciated that the light emitted by LED 1216 may be directed entirelyor partially above or through the surface of interactive surface element1208. The light emitted by LED 1216 may be directed generally parallelto the surface of interactive surface element 1208 or may be angled withrespect thereto by up to typically 45 degrees. A suitable IR emittingLED is, for example, an IR-emitting SMD-LED commercially available fromOSA Opto Light GmbH of Berlin, Germany under catalog designatorOIS-210-X-T. It is appreciated that selection of a specific shape andsize and orientation of LED 1216 may be affected by the specificplacement of LED 1216 relative to detector arrays 1202 and theinteraction between a light beam emitted from the LED 1216 and thevarious components of the interactive device, including the interactivesurface element 1208, the detector elements 1204 and other layers of theinteractive device. Optionally, the light emitted by LED 1216 may bemodulated by modulating circuitry (not shown).

The illumination subassembly 1212 may be associated with the interactivesurface element 1208 or may be associated with another part of theinteractive device, such as display element 1209.

It is a particular feature of the embodiment of FIG. 18A thatinteractive surface element 1208 has a first region, overlying displayelement 1209, having first user sensible functionality and a secondregion, extending beyond display element 1209, having secondfunctionality, different from the first user sensible functionality.

It is a further particular feature of the embodiment of FIG. 18A thatboth the first and second functionalities employ a common detectorassembly and may employ a common source of light, such as illuminationsubassembly 1212.

Light, preferably including light in the IR band emitted by illuminationsubassembly 1212, is reflected from a user's finger, a stylus (notshown) or any other suitable reflective object, touching or located inpropinquity to interactive surface element 1208. The reflected light ispropagated within interactive surface element 1208 as by scattering andis detected by one or more of detector elements 1204. Alternatively oradditionally, the reflected light is propagated above the surface ofinteractive surface element 1208 and is detected by one or more ofdetector elements 1204, which may extend slightly above edges 1206.Furthermore, additionally or alternatively, the reflected light maypropagate or be transmitted through interactive surface element 1208directly to one or more of detector elements 1204 without appreciablescattering and detected thereby. When the user's finger touches or islocated in propinquity to interactive surface element 1208, the lightreflected from the finger is detected by one or more of detectorelements 1204, as described hereinabove, in addition to the baselinelevel of light detected by the detector elements 1204. Detectoranalyzing processing circuitry (not shown) preferably receives outputsof the detector elements 1204 on detector arrays 1202, digitallyprocesses these outputs and determines whether the absolute amount oflight detected by each of the detector elements 1204 or the change inthe amount of light detected by each of the detector elements 1204exceeds a predetermined threshold.

The amount of light detected by the individual detector elements 1204 ona given detector array 1202, as determined by the detector analyzingprocessing circuitry, is further processed to provide an array detectionoutput which incorporates the outputs of individual detector elements ofa given detector array 1202. The array detection output represents therelationship between intensity and position along a given dimensionalong which the array extends.

The array detection output includes information corresponding to thelocation of an impingement point of the user's finger relative to thegiven detector array 1202. Typically, the location of at least onedetector element 1204, in which the amount of light measured or thechange in the amount of light measured exceeds a predeterminedthreshold, corresponds to the location of the user's finger along anaxis parallel to the given detector array 1202.

In the configuration shown in FIG. 18 A, three-dimensional locationdetermining circuitry (not shown) preferably calculates thetwo-dimensional position of the impingement point of the user's fingeron or above interactive surface element 1208 by combining the arraydetection outputs of at least two detector arrays, typically arrangedalong at least two mutually perpendicular edges 1206 of interactivesurface element 1208. Additionally, the three-dimensional locationdetermining circuitry calculates the extent of proximity of the user'sfinger to the interactive surface element 1208. FIG. 18A shows thefinger separated by a distance H from the surface of the interactivesurface element 1208, in a hover state. Three-dimensional locationdetermining circuitry is operative to distinguish between a fingertouching the surface of interactive surface element 1208, a fingerhovering thereover, as shown in FIG. 18A, and a situation wherein thereis no detection of a finger in propinquity to the interactive surfaceelement. This may be achieved, for example, by noting a clear differencein overall signal intensity produced by touch as opposed to hover.Another example is by noting a clear difference in the shape of thearray detection output resulting from touch as opposed to hover, whichdifference is generally independent of the intensity level. A furtherexample is by noting a clear difference in the width of the arraydetection output resulting from touch as opposed to hover, whichdifference is generally independent of the intensity level.

Reference is now made to FIG. 18B, which shows arrays 1222 of lightdetector elements 1224 arranged at least two mutually perpendicularedges 1226 of an interactive surface element 1228, preferably associatedwith a display element 1229, such as an LCD display. Interactive surfaceelement 1228 may wholly or partially coincide with a viewing plane whichoverlies display element 1229. Display element 1229 is preferablysmaller in area than the interactive surface element 1228.

Alternatively, detector arrays 1222 may be provided along all or most ofthe edges 1226. As a further alternative, a single detector array 1222may be provided along only one edge 1226 of the interactive surfaceelement 1228. Interactive surface element 1228 may be a single ormultiple layer plate and may have one or more coating layers associatedtherewith.

It is appreciated that the phrase “at edges” is to be interpretedbroadly as including structures which are located behind edges, as inthe embodiments shown in FIGS. 10A-10D, 11A-11D, 15A-15D and 16A-16D,about edges as in the embodiments shown in FIGS. 9A-9D and 14A-14D, andalong edges as in the embodiments shown in FIGS. 4-7, 8A-8D, 12A-12D and13A-13D.

Suitable detector elements are, for example, Solderable SiliconPhotodiodes commercially available from Advanced Photonix Incorporatedof Camarillo, Calif., USA under catalog designator PDB-C601-1. Theinteractive assembly shown in FIG. 18B preferably includes anillumination subassembly 1232 which typically includes one or moreelectromagnetic radiation emitting sources. The illumination subassembly1232 may provide a baseline illumination level which is typicallydetected by detector elements 1224. The structure and location of theillumination subassembly are preferably selected to provide a desiredbaseline illumination level or to minimize the baseline illuminationlevel.

In accordance with a preferred embodiment of the present disclosure,shown in FIG. 18B, a single IR emitting LED 1236 is provided at orgenerally adjacent to an intersection of mutually perpendicular edges1226 along which detector elements 1224 are not arranged. The LED 1236is arranged such that light emitted therefrom is projected generallyacross the surface of interactive surface element 1228. It isappreciated that the light emitted by LED 1236 may be directed entirelyor partially above or through the surface of interactive surface element1228. The light emitted by LED 1236 may be directed generally parallelto the surface of interactive surface element 1228 or may be angled withrespect thereto by up to typically 45 degrees. A suitable IR emittingLED is, for example, an IR-emitting SMD-LED commercially available fromOSA Opto Light GmbH of Berlin, Germany under catalog designatorOIS-210-X-T. It is appreciated that selection of a specific shape andsize of LED 1236 may be affected by the specific placement of LED 1236relative to detector arrays 1222 and the interaction between a lightbeam emitted from the LED 1236 and the various components of theinteractive device, including the interactive surface element 1228, thedetector elements 1224 and other layers of the interactive device.Optionally, the light emitted by LED 1236 may be modulated by modulatingcircuitry (not shown).

Light, preferably including light in the IR band emitted by illuminationsubassembly 1232, may be propagated generally across the surface ofinteractive surface element 1228 and a reflected portion thereof may bedetected by one or more of detector elements 1224. Alternatively oradditionally, the light may be propagated above the surface ofinteractive surface element 1228 and a reflected portion thereof may bedetected by one or more of detector elements 1224, which may optionallyextend slightly above edges 1226. Furthermore, additionally oralternatively, the reflected light may propagate or be transmittedthrough interactive surface element 1228 directly to one or more ofdetector elements 1224 and detected thereby. The light is reflected by auser's finger, a stylus (not shown) or any other suitable object,touching or located in propinquity to interactive surface element 1228.When the user's finger touches or is located in propinquity tointeractive surface element 1228, the amount of light detected by one ormore of detector elements 1224 is typically changed relative to thebaseline level of light detected by the detector elements 1224. Detectoranalyzing processing circuitry (not shown) preferably receives outputsof the detector elements 1224 on detector arrays 1222, digitallyprocesses these outputs and determines whether the absolute amount oflight detected by each of the detector elements 1224 is below apredetermined threshold, or whether the change in the amount of lightdetected by each of the detector elements 1224 exceeds a predeterminedthreshold.

The amount of light detected by the individual detector elements 1224 ona given detector array 1222, as determined by the detector analyzingprocessing circuitry, is further processed to provide an array detectionoutput. The array detection output includes information corresponding tothe location of an impingement point of the user's finger relative tothe given detector array 1222. Typically, the location of at least onedetector element 1224, in which the amount of light measured is below apredetermined threshold or the change in the amount of light measuredexceeds a predetermined threshold, corresponds to the location of theuser's finger along an axis parallel to the given detector array 1222.

In the configuration shown in FIG. 18B, two-dimensional locationdetermining circuitry (not shown) preferably calculates thetwo-dimensional position of the impingement point of the user's fingeron or above interactive surface element 1228 by combining the arraydetection outputs of at least two detector arrays, typically arrangedalong at least two mutually perpendicular edges 1226 of interactivesurface element 1228.

The illumination subassembly 1232 may be associated with the interactivesurface element 1228 or may be associated with another part of theinteractive device, such as display element 1229.

It is a particular feature of the embodiment of FIG. 18B thatinteractive surface element 1228 has a first region, overlying displayelement 1229, having first user sensible functionality and a secondregion, extending beyond display element 1229, having secondfunctionality, different from the first user sensible functionality.

It is a further particular feature of the embodiment of FIG. 18B thatboth the first and second functionalities employ a common detectorassembly and may employ a common source of light, such as illuminationsubassembly 1232.

Reference is now made to FIG. 18C, which shows an array 1242 of detectorelements 1244 arranged in a plane, parallel to a viewing plane 1246. Asseen in FIG. 18C, in one example of a display and input devicestructure, detector array 1242 is arranged at least partially behind anIR transmissive display panel 1248, such as a panel including LCD orOLED elements, underlying an interactive surface element 1250. It isappreciated that the interactive surface element 1250 may extend beyondthe extent of the display panel 1248. In accordance with a preferredembodiment of the present disclosure, the array 1242 is formed of aplurality of discrete detector elements 1244 placed on a planeintegrally formed therewith so as to preferably sense light impinging atregions of interactive surface element 1250 both overlying and notoverlying the display panel 1248. Alternatively, the array 1242 may beformed of one or more CCD or CMOS arrays, or may be created byphotolithography.

Interactive surface element 1250 may be a single or multiple layer plateand may have one or more coating layers associated therewith. In oneexample of an integrated display and input system employing an LCD,there are provided one or more light diffusing layers 1252 overlying areflector 1254. One or more collimating layers 1256 are typicallyinterposed between reflector 1254 and IR transmissive display panel1248. The interactive assembly shown in FIG. 18C preferably includes anillumination subassembly 1262 which typically includes one or moreelectromagnetic radiation emitting sources. The illumination subassembly1262 preferably provides a baseline illumination level which istypically detected by detector elements 1244.

In accordance with a preferred embodiment of the present disclosure,shown in FIG. 18C, illumination subassembly 1262 includes a generallylinear arrangement of multiple IR emitting LEDs 1266, in parallel withone or more of edges 1268 of the interactive device. The LEDs 1266 arearranged such that light emitted therefrom is projected generally acrossthe surface of interactive surface element 1208. Suitable IR emittingLEDs are, for example, IR-emitting SMD-LEDs commercially available fromOSA Opto Light GmbH of Berlin, Germany under catalog designatorOIS-210-X-T. It is appreciated that selection of a specific shapes andsizes of LEDs 1266 may be affected by the specific placement of the LEDs1266 relative to array 1242 and the interaction between light beamsemitted from the LEDs 1266 and the various components of the interactivedevice, including the interactive surface element 1250, the detectorelements 1244, the diffusing layers 1252, collimating layers 1256,reflecting layers 1254 and other layers of the interactive device.Optionally, the light emitted by LEDs 1266 may be modulated bymodulating circuitry (not shown).

It is a particular feature of the embodiment of FIG. 18C thatinteractive surface element 1250 has a first region, overlying displayelement 1248, having first user sensible functionality and a secondregion, extending beyond display element 1248, having secondfunctionality, different from the first user sensible functionality.

It is a further particular feature of the embodiment of FIG. 18C thatboth the first and second functionalities may employ a common detectorassembly and may employ a common source of light, such as illuminationsubassembly 1262. Alternatively different detector assemblies may beprovided for the first and second regions. Light, preferably includinglight in the IR band emitted by illumination subassembly 1262, isreflected from a user's finger, a stylus (not shown) or any othersuitable reflective object, touching or located in propinquity tointeractive surface element 1250. The reflected light is propagatedthrough interactive surface element 1250 and is detected by one or moreof detector elements 1244. When the user's finger touches or is locatedin propinquity to interactive surface element 1250, the light reflectedfrom the finger is detected by one or more of detector elements 1244, asdescribed hereinabove, in addition to the baseline level of lightdetected by the detector elements 1244. Detector analyzing processingcircuitry (not shown) preferably receives outputs of the detectorelements 1244 on detector array 1242, digitally processes these outputsand determines whether the absolute amount of light detected by each ofthe detector elements 1244 or the change in the amount of light detectedby each of the detector elements 1244 exceeds a predetermined threshold.

The amount of light detected by the individual detector elements 1244 asdetermined by the detector analyzing processing circuitry, is furtherprocessed to provide an array detection output. The array detectionoutput includes information corresponding to the location of animpingement point of the user's finger relative to array 1242.Typically, the location of at least one detector element 1244, in whichthe amount of light measured or the change in the amount of lightmeasured exceeds a predetermined threshold, corresponds to thetwo-dimensional location of the user's finger in a plane parallel toarray 1242. In the configuration shown in FIG. 18C, optionalthree-dimensional location determining circuitry (not shown) may beprovided to calculate the three-dimensional (X, Y, Z and/or angularorientation) position of the impingement point of the user's finger onor above interactive surface element 1250 by processing the detectorelement outputs of at least two detector elements to define the shapeand size of an impingement area, as described in assignee's U.S.Provisional Patent Application Nos. 60/715,546; 60/734,027; 60/789,188and 60/682,604, U.S. Patent Application Publication No. 2005/0156914A1and PCT Patent Application Publication No. WO 2005/094176, thedisclosures of which are hereby incorporated by reference.

Reference is now made FIG. 18D, which shows arrays 1272 of lightdetector elements 1274 arranged at least two mutually perpendicularedges 1276 of an interactive surface element 1278. Alternatively,detector arrays 1272 may be provided along all or most of the edges1276. As a further alternative, a single detector array 1272 may beprovided along only one edge 1276 of the interactive surface element1278. Interactive surface element 1278 may be a single or multiple layerplate and may have one or more coating layers associated therewith.Optionally, one or more of detector arrays 1272 may be arranged suchthat the detector elements 1274 thereof extend slightly above thesurface of interactive surface element 1278.

It is appreciated that the phrase “at edges” is to be interpretedbroadly as including structures which are located behind edges, as inthe embodiments shown in FIGS. 10A-10D, 11A-11D, 15A-15D and 16A-16D,about edges as in the embodiments shown in FIGS. 9A-9D and 14A-14D, andalong edges as in the embodiments shown in FIGS. 4-7, 8A-8D, 12A-12D and13A-13D.

Suitable detector elements are, for example, Solderable SiliconPhotodiodes commercially available from Advanced Photonix Incorporatedof Camarillo, Calif., USA under catalog designator PDB-C601-1. Theinteractive assembly shown in FIG. 18D preferably includes anillumination subassembly 1282 which typically includes one or moreelectromagnetic radiation emitting sources. The illumination subassembly1282 preferably provides a baseline illumination level which istypically detected by detector elements 1274.

In accordance with a preferred embodiment of the present disclosure,shown in FIG. 18D, illumination subassembly 1282 includes one or more ERemitting LEDs 1286, generally adjacent to, or interspersed among, alinear arrangement of display backlight LEDs (not shown), typicallyprovided underlying and aligned with edges of a plane of an IRtransmissive display panel 1288, such as an LCD or OLED, which partiallyunderlies and is generally parallel to interactive surface element 1278.A suitable ER emitting LED is, for example, an SMD type ER GaAs LEDcommercially available from Marubeni America Corporation of Santa Clara,Calif., USA under catalog designator SMC940. It is appreciated thatselection of a specific shapes and sizes of LEDs 1286 may be affected bythe specific placement of LEDs 1286 relative to detector arrays 1272 andthe interaction between light beams emitted from the LEDs 1286, lightbeams emitted from other backlight LEDs, and the various components ofthe interactive device, including backlight LEDs, the interactivesurface element 1278, the detector elements 1274 and other layers of theinteractive device. Optionally, the light emitted by LED 1286 may bemodulated by modulating circuitry (not shown).

It is a particular feature of the embodiment of FIG. 18D thatinteractive surface element 1278 has a first region, overlying displaypanel 1288, having first user sensible functionality and a secondregion, extending beyond display panel 1288, having secondfunctionality, different from the first user sensible functionality.

It is a further particular feature of the embodiment of FIG. 18D thatboth the first and second functionalities may employ a common detectorassembly and may employ a common source of light, such as illuminationsubassembly 1282. Alternatively, different detector assemblies may beprovided for the first and second regions.

In one preferred embodiment of the present disclosure, the detectorelements 1274 are operative to detect visible wavelengths of lightemitted from visible light-emitting backlight LEDs. In another preferredembodiment of the present disclosure, backlight LEDs are selected toprovide both IR and visible light wavelength emissions. In a furtheralternative embodiment of the present disclosure, two different sets ofLEDs may be provided for different wavelengths.

The IR emitting LEDs 1286 are arranged such that light emitted therefromis projected generally through one or more diffusing and/or collimatinglayers 1290 typically underlying the IR transmissive display panel 1288.The IR emitting LEDs 1286 may additionally or alternatively be arrangedsuch that light emitted therefrom is reflected by one or more reflectinglayers 1292, underlying and generally parallel to the plane of the IRtransmissive display panel 1288. Typically, both diffusing layers 1290and reflecting layers 1292 are provided, to aid in propagating thebacklight and IR light through the transmissive display panel 1288.

Light, preferably including light in the IR band emitted by illuminationsubassembly 1282, is reflected from a user's finger, a stylus (notshown) or any other suitable reflective object, touching or located inpropinquity to interactive surface element 1278. The reflected light ispropagated within interactive surface element 1278 and is detected byone or more of detector elements 1274. Alternatively or additionally,the reflected light is propagated above the surface of interactivesurface element 1278 and is detected by one or more of detector elements1274, which may extend slightly above edges 1276. Furthermore,additionally or alternatively, the reflected light may propagate or betransmitted through interactive surface element 1278 directly to one ormore of detector elements 1274 and detected thereby.

When the user's finger touches or is located in propinquity tointeractive surface element 1278, the light reflected from the finger isdetected by one or more of detector elements 1274, as describedhereinabove, in addition to the baseline level of light detected by thedetector elements 1274. Detector analyzing processing circuitry (notshown) preferably receives outputs of the detector elements 1274 ondetector arrays 1272, digitally processes these outputs and determineswhether the absolute amount of light detected by each of the detectorelements 1274 or the change in the amount of light detected by each ofthe detector elements 1274 exceeds a predetermined threshold.

The amount of light detected by the individual detector elements 1274 ona given detector array 1272, as determined by the detector analyzingprocessing circuitry, is further processed to provide an array detectionoutput. The array detection output includes information corresponding tothe location of an impingement point of the user's finger relative tothe given detector array 1272. Typically, the location of at least onedetector element 1274, in which the amount of light measured or thechange in the amount of light measured exceeds a predeterminedthreshold, corresponds to the location of the user's finger along anaxis parallel to detector array 1272. In the configuration shown in FIG.18D, two-dimensional location determining circuitry (not shown)preferably calculates the two-dimensional position of the impingementpoint of the user's finger on or above interactive surface element 1278by combining the array detection outputs of at least two arrays,typically arranged along at least two mutually perpendicular edges 1276of interactive surface element 1278. Reference is now made to FIG. 18E,which shows a single array 1302 of light detector elements 1304 arrangedat an edge 1306 of an interactive surface element 1308, preferablyassociated with a display element 1309, such as an LCD display.

Interactive surface element 1308 may wholly or partially coincide with aviewing plane which overlies display element 1309. Display element 1309is preferably smaller in area than interactive surface element 1308.Interactive surface element 1308 may be a single or multiple layerinteractive surface element and may have one or more coating layersassociated therewith.

It is appreciated that the phrase “at an edge” is to be interpretedbroadly as including structures which are located behind an edge, as inthe embodiments shown in FIGS. 10A-10D, 11A-11D, 15A-15D and 16A-16D,about an edge as in the embodiments shown in FIGS. 9A-9D and 14A-14D,and along an edge as in the embodiments shown in FIGS. 4-7, 8A-8D,12A-12D and 13A-13D.

Suitable detector elements are, for example, Solderable SiliconPhotodiodes commercially available from Advanced Photonix Incorporatedof Camarillo, Calif., USA under catalog designator PDB-C601-1.

The interactive assembly shown in FIG. 18E preferably includes anillumination subassembly 1312 which typically includes one or moreelectromagnetic radiation emitting sources. The illumination subassembly1312 preferably provides a baseline illumination level which istypically detected by detector elements 1304.

In accordance with a preferred embodiment of the present disclosure,shown in FIG. 18E, illumination subassembly 1312 includes a generallylinear arrangement of multiple IR emitting LEDs 1316. The LEDs 1316 arearranged such that light emitted therefrom is projected generally acrossthe surface of interactive surface element 1308. Illuminationsubassembly 1312 may be arranged in parallel to detector array 1302, atan edge perpendicular to detector array 1302, or may be arranged at anedge opposite or otherwise not adjacent or perpendicular to detectorarray 1302. Suitable IR emitting LEDs are, for example, the IR-emittingSMD-LEDs commercially available from OSA Opto Light GmbH of Berlin,Germany under catalog designator OIS-210-X-T. It is appreciated thatselection of a specific shapes and sizes of LEDs 1316 may be affected bythe specific placement of the illumination subassembly 1312 relative todetector array 1302 and the interaction between light beams emitted fromthe LEDs 1316 and the various components of the interactive device,including the interactive surface element 1308, the detector elements1304 and other layers of the interactive device. Optionally, the lightemitted by LEDs 1316 may be modulated by modulating circuitry (notshown).

Light, preferably including light in the IR band emitted by illuminationsubassembly 1312, is reflected from a user's finger, a stylus (notshown) or any other suitable reflective object, touching or located inpropinquity to interactive surface element 1308. The reflected light ispropagated within interactive surface element 1308 and is detected byone or more of detector elements 1304. Alternatively or additionally,the reflected light is propagated above the surface of interactivesurface element 1308 and is detected by one or more of detector elements1304, which may extend slightly above edge 1306. Furthermore,additionally or alternatively, the reflected light may propagate or betransmitted through interactive surface element 1308 directly to one ormore of detector elements 1304 and detected thereby.

When the user's finger touches or is located in propinquity tointeractive surface element 1308, the light reflected from the finger isdetected by one or more of detector elements 1304, as describedhereinabove, in addition to the baseline level of light detected by thedetector elements 1304. Detector analyzing processing circuitry (notshown) preferably receives outputs of the detector elements 1304 ondetector array 1302, digitally processes these outputs and determineswhether the absolute amount of light detected by each of the detectorelements 1304 or the change in the amount of light detected by each ofthe detector elements 1304 exceeds a predetermined threshold.

The amount of light detected by the individual detector elements 1304 onarray 1302, as determined by the detector analyzing processingcircuitry, is further processed to provide an array detection output.The array detection output includes information corresponding to thelocation of an impingement point of the user's finger relative todetector array 1302. Typically, the location of at least one detectorelement 1304, in which the amount of light measured or the change in theamount of light measured exceeds a predetermined threshold, correspondsto the location of the user's finger along an axis parallel to array1302.

In the configuration shown in FIG. 18E, three-dimensional locationdetermining circuitry (not shown) preferably calculates thetwo-dimensional position of the impingement point of the user's fingeron or above interactive surface element 1308 by further utilizing thearray detection output and the information corresponding to the locationof the impingement point of the user's finger relative to the arrayincluded therein, as described herein below.

Whereas the location of at least one detector element 1304 on array1302, in which the amount of light measured or the change in the amountof light measured exceeds a predetermined threshold, corresponds to thelocation of the user's finger along an axis parallel to array 1302, thestrength of the signal output of that detector element 1304 decreases asthe distance, designated by X in FIG. 18E, of the impingement point ofthe user's finger from array 1302 along an axis generally perpendicularto the axis of the array 1302 increases. Conversely, the strength of thesignal output of the detector element 1304 increases as the distance ofthe impingement point of the user's finger from array 1302 along an axisgenerally perpendicular to the axis of the array 1302 decreases. Thesecharacteristics of the various components of the interactive assemblyare employed by the two-dimensional location determining circuitry tocalculate the two-dimensional position of the impingement point of theuser's finger on the interactive surface element 1308 or above it.

Reference is now made to FIG. 18F, which shows an integrated display andinput device having touch responsive input functionality. As seen inFIG. 18F, a multiplicity of light detector elements 1322 areinterspersed among light emitters 1324 arranged in a plane 1326underlying an interactive surface element 1328 coinciding with a viewingplane. Examples of such a structure are described in U.S. Pat. No.7,034,866 and U.S. Patent Application Publication Nos. 2006/0132463A1,2006/0007222A1 and 2004/00012565A1, the disclosures of which are herebyincorporated by reference.

Interactive surface element 1328 may be a single or multiple layer plateand may have one or more coating layers associated therewith. In oneexample of an integrated display and input system employing lightdetector elements interspersed among light emitting elements, there areprovided one or more light diffusing layers 1330 overlying a reflector1332. One or more collimating layers 1334 may be interposed betweenreflector 1332 and the plane 1326 which includes the light detector andlight emitting elements.

The interactive assembly shown in FIG. 18F preferably includes anillumination subassembly 1342 which typically includes one or moreelectromagnetic radiation emitting sources. The illumination subassembly1342 typically provides a baseline illumination level which is typicallydetected by detector elements 1322.

In accordance with a preferred embodiment of the present disclosure,shown in FIG. 18F, illumination subassembly 1324 includes a generallylinear arrangement of multiple IR emitting LEDs 1346, generally inparallel with one or more of edges 1348 of interactive surface element1328. The LEDs 1346 are arranged such that light emitted therefrom isprojected generally across the surface of interactive surface element1328. Suitable IR emitting LEDs are, for example, IR-emitting SMD-LEDscommercially available from OSA Opto Light GmbH of Berlin, Germany undercatalog designator OIS-210-X-T. It is appreciated that selection of aspecific shapes and sizes of LEDs 1346 may be affected by the specificplacement of the LEDs 1346 relative to plane 1326 and the interactionbetween one or more light beams emitted from LEDs 1346 and the variouscomponents of the interactive assembly including the interactive surfaceelement 1328, the detector elements 1322, diffusing layers 1330,collimating layers 1334, reflecting layers 1332 and other layers of theinteractive device. Optionally, the light emitted by LEDs 1346 may bemodulated by modulating circuitry (not shown).

It is a particular feature of the embodiment of FIG. 18F thatinteractive surface element 1328 has a first region, overlying plane1326, having first user sensible functionality and a second region,extending beyond plane 1326, having second functionality, different fromthe first user sensible functionality.

It is a further particular feature of the embodiment of FIG. 18F thatboth the first and second functionalities may employ a common detectorassembly and may employ a common source of light, such as illuminationsubassembly 1342. Alternatively, different detector assemblies may beprovided for the first and second regions.

Light, preferably including light in the IR band emitted by illuminationsubassembly 1342, is reflected from a user's finger, a stylus (notshown) or any other suitable reflective object, touching or located inpropinquity to interactive surface element 1328. The reflected light ispropagated through interactive surface element 1328 and is detected byone or more of detector elements 1322.

When the user's finger touches or is located in propinquity tointeractive surface element 1328, the light reflected from the finger isdetected by one or more of detector elements 1322, in addition to thebaseline level of light detected by the detector elements 1322. Detectoranalyzing processing circuitry preferably receives outputs of thedetector elements 1322, digitally processes these outputs and determineswhether the absolute amount of light detected by each of the detectorelements 1322 or the change in the amount of light detected by each ofthe detector elements 1322 exceeds a predetermined threshold.

The amount of light detected by the individual detector elements 1322,as determined by the detector analyzing processing circuitry, is furtherprocessed to provide an array detection output. The array detectionoutput includes information corresponding to the location of animpingement point of the user's finger. Typically, the location of atleast one detector element 1322, in which the amount of light measuredor the change in the amount of light measured exceeds a predeterminedthreshold, corresponds to the two-dimensional location of the user'sfinger on or above interactive surface element 1328 and parallel toplane 1326. In the configuration shown in FIG. 18F, optionalthree-dimensional location determining circuitry (not shown) may beprovided to calculate the three-dimensional (X, Y, Z and/or angularorientation) position of the impingement point of the user's finger onor above interactive surface element 1328 by processing the detectorelement outputs of at least two detector elements to define the shapeand size of an impingement area, as described in assignee's U.S.Provisional Patent Application Nos. 60/715,546; 60/734,027; 60/789,188and 60/682,604, U.S. Patent Application Publication No. 2005/0156914A1and PCT Patent Application Publication No. WO 2005/094176, thedisclosures of which are hereby incorporated by reference.

It is appreciated that any of the configurations of the illuminationsubassemblies shown in the embodiments of FIGS. 18A-18F may be combinedwith any of the detector array configurations shown in FIGS. 1-17C.

Reference is now made to FIG. 19, which is a simplified illustration ofan interactive assembly constructed and operative in accordance with apreferred embodiment of the present disclosure, utilizingelectromagnetic radiation from a source external to the interactivedevice.

As seen in FIG. 19, arrays 1402 of light detector elements 1404 arearranged at least two mutually perpendicular edges 1406 of aninteractive surface element 1408, preferably associated with a displayelement 1409, such as an LCD display. Alternatively, detector arrays1402 may be provided along all or most of the edges 1406. As a furtheralternative, a single detector array 1402 may be provided along only oneedge 1406 of the interactive surface element 1408. Interactive surfaceelement 1408 may be a single or multiple layer plate and may have one ormore coating layers associated therewith.

It is a particular feature of the embodiment of FIG. 19 that interactivesurface element 1408 has a first region, overlying display element 1409,having first user sensible functionality and a second region, extendingbeyond display element 1409, having second functionality, different fromthe first user sensible functionality.

It is a further particular feature of the embodiment of FIG. 19 thatboth the first and second functionalities may employ a common detectorassembly and may employ a common source of light, such as an external orambient light source.

Alternatively, different detector assemblies may be provided for thefirst and second regions.

It is appreciated that the phrase “at edges” is to be interpretedbroadly as including structures which are located behind edges, as inthe embodiments shown in FIGS. 10A-10D, 11A-11D, 15A-15D and 16A-16D,about edges as in the embodiments shown in FIGS. 9A-9D and 14A-14D, andalong edges as in the embodiments shown in FIGS. 4-7, 8A-8D, 12A-12D and13A-13D.

Suitable detector elements are, for example, Solderable SiliconPhotodiodes commercially available from Advanced Photonix Incorporatedof Camarillo, Calif., USA under catalog designator PDB-C601-1.

Light incident upon the viewing interactive surface element 1408,preferably including light in the IR band emitted by one or more sourcesof illumination external to the interactive device, is propagated withininteractive surface element 1408 and is detected by one or more ofdetector elements 1404. Alternatively or additionally, the incidentlight is propagated above the surface of interactive surface element1408 and is detected by one or more of detector elements 1404, which mayextend slightly above edges 1406. Furthermore, additionally oralternatively, the incident light may propagate or be transmittedthrough interactive surface element 1408 directly to one or more ofdetector elements 1404 and detected thereby. The detection of incidentlight by detector elements 1404 defines a baseline illumination leveltherefor.

Light, preferably including light in the IR band emitted by one or moresources of illumination external to the interactive device, is reflectedfrom a user's finger, a stylus (not shown) or any other suitablereflective object, touching or located in propinquity to interactivesurface element 1408. The reflected light is propagated withininteractive surface element 1408 and is detected by one or more ofdetector elements 1404. Alternatively or additionally, the reflectedlight is propagated above the surface of interactive surface element1408 and is detected by one or more of detector elements 1404, which mayextend slightly above edges 1406. Furthermore, additionally oralternatively, the reflected light may propagate or be transmittedthrough interactive surface element 1408 directly to one or more ofdetector elements 1404 and detected thereby. Suitable external lightsources include sunlight, artificial room lighting and IR radiationemitted from a human body or other heat source. In an alternatepreferred embodiment, the quantity or intensity of the reflected lightmay be augmented by the addition of an illumination subassembly (notshown) which typically includes one or more electromagnetic radiationemitting sources. Examples of various suitable configurations of anillumination subassembly are described hereinabove with reference toFIGS. 18A-18F.

When the user's finger touches or is located in propinquity tointeractive surface element 1408, the light reflected from the finger isdetected by one or more of detector elements 1404, as describedhereinabove, in addition to the baseline level of light detected by thedetector elements 1404. Detector analyzing processing circuitry (notshown) preferably receives outputs of the detector elements 1404 onarrays 1402, digitally processes these outputs and determines whetherthe absolute amount of light detected by each of the detector elements1404 or the change in the amount of light detected by each of thedetector elements 1404 exceeds a predetermined threshold. The amount oflight detected by the individual detector elements 1404 on a given array1402, as determined by the detector analyzing processing circuitry, isfurther processed to provide an array detection output. The arraydetection output includes information corresponding to the location ofan impingement point of the user's finger relative to the given array1402. Typically, the location of at least one detector element 1404, inwhich the amount of light measured or the change in the amount of lightmeasured exceeds a predetermined threshold, corresponds to the locationof the user's finger along an axis parallel to array 1402.

In the configuration shown in FIG. 19, two-dimensional locationdetermining circuitry (not shown) preferably calculates thetwo-dimensional position of the impingement point of the user's fingeron or above interactive surface element 1408 by combining the arraydetection outputs of at least two arrays, typically arranged along atleast two mutually perpendicular edges 1406 of interactive surfaceelement 1408.

Reference is now made to FIGS. 20A, 20B, 21A, 21B and 22, which aresimplified illustrations of an alternative embodiment of an illuminationsubassembly forming part of an interactive assembly constructed andoperative in accordance with another preferred embodiment of the presentdisclosure. Alternatively or additionally, a touch responsive inputfunctionality and/or propinquity responsive input functionality maypreferably be operative to detect the positions of one or more fingers,a stylus (not shown) or any other suitable reflective object.

FIGS. 20A-22 show an interactive assembly having touch responsive inputfunctionality and/or propinquity responsive input functionality, whichis useful for application selection and operation, such as emailcommunication and Internet surfing. The input functionality mayincorporate any one or more features of assignee's U.S. ProvisionalPatent Application Nos. 60/715,546; 60/734,027; 60/789,188 and60/682,604, U.S. Patent Application Publication No. 2005/0156914A1 andPCT Patent Application Publication No. WO 2005/094176, the disclosuresof which are hereby incorporated by reference.

FIGS. 20A-22 illustrate object detection functionality of the typedescribed hereinabove with reference to FIGS. 1A to 1F. As shown, aposition of a user's fingers is detected by means of a touch responsiveinput functionality and/or propinquity responsive input functionalityoperative in accordance with preferred embodiments of the presentdisclosure.

As seen in FIGS. 20A-22, it is seen that arrays 1502 of light detectorelements 1504 are arranged at least two mutually perpendicular edges1506 of an interactive surface element 1508, preferably associated witha display element 1509, such as an LCD display. Interactive surfaceelement 1508 may wholly or partially coincide with a viewing plane whichoverlies display element 1509. Display element 1509 is preferablysmaller in area than the interactive surface element 1508.Alternatively, detector arrays 1502 may be provided along all or most ofthe edges 1506. As a further alternative, a single detector array 1502may be provided along only one edge 1506 of the interactive surfaceelement 1508. Interactive surface element 1508 may be a single ormultiple layer plate and may have one or more coating layers associatedtherewith. It is appreciated that the phrase “at edges” is to beinterpreted broadly as including structures which are located behindedges, as in the embodiments shown in FIGS. 10A-10D, 11A-11D, 15A-15Dand 16A-16D, about edges as in the embodiments shown in FIGS. 9 A-9D and14A-14D, and along edges as in the embodiments shown in FIGS. 4-7,8A-8D, 12A-12D and 13A-13D. Suitable detector elements are, for example,Solderable Silicon

Photodiodes commercially available from Advanced Photonix Incorporatedof Camarillo, Calif., USA under catalog designator PDB-C601-1.

The interactive assembly shown in FIGS. 20A-22 preferably includes anillumination subassembly 1512 which typically includes one or moreelectromagnetic radiation emitting sources. The illumination subassembly1512 preferably provides a baseline illumination level which istypically detected by detector elements 1504.

In accordance with a preferred embodiment of the present disclosure,shown in FIGS. 20A-22, illumination subassembly includes a single IRemitting LED 1516 at or generally adjacent to an intersection of themutually perpendicular edges 1506 along which detector elements 1514 arearranged. The LED 1516 is arranged such that light emitted therefrom isprojected generally across the surface of interactive surface element1508. A suitable IR emitting LED is, for example, an IR-emitting SMD-LEDcommercially available from OSA Opto Light GmbH of Berlin, Germany undercatalog designator OIS-210-X-T. It is appreciated that selection of aspecific shape and size of LED 1516 may be affected by the specificplacement of LED 1516 relative to detector arrays 1502 and theinteraction between a light beam emitted from the LED 1516 and thevarious components of the interactive device, including the interactivesurface element 1508, the detector elements 1504 and other layers of theinteractive device. Optionally, the light emitted by LED 1516 may bemodulated by modulating circuitry (not shown).

It is a particular feature of the embodiment of FIGS. 20A-22 thatinteractive surface element 1508 has a first region, overlying displayelement 1509, having first user sensible functionality and a secondregion, extending beyond display element 1509, having secondfunctionality, different from the first user sensible functionality.

It is a further particular feature of the embodiment of FIGS. 20A-22that both the first and second functionalities may employ a commondetector assembly and may employ a common source of light, such asillumination subassembly 1512. Alternatively, different detectorassemblies may be provided for the first and second regions.

Light, preferably including light in the IR band emitted by illuminationsubassembly 1512, is reflected from a user's fingers, a stylus (notshown) or any other suitable reflective object, touching or located inpropinquity to interactive surface element 1508. The reflected light ispropagated within interactive surface element 1508 and is detected byone or more of detector elements 1504. Alternatively or additionally,the reflected light is propagated above the surface of interactivesurface element 1508 and is detected by one or more of detector elements1504, which may extend slightly above edges 1506. Furthermore,additionally or alternatively, the reflected light may propagate or betransmitted through interactive surface element 1508 directly to one ormore of detector elements 1504 and detected thereby.

As seen in FIGS. 20A and 20B, the user's fingers are adjacent to oneanother. In FIG. 20A, the user's fingers are located in propinquity tointeractive surface element 1508, at a height H therefrom, and in FIG.20B, the user's fingers touch interactive surface element 1508.

When the user's fingers touch, as in FIG. 20B, or are located inpropinquity to, as in FIG. 20A, interactive surface element 1508, thelight reflected from the fingers is detected by one or more of detectorelements 1504, as described hereinabove, in addition to the baselinelevel of light detected by the detector elements 1504. Detectoranalyzing processing circuitry (not shown) preferably receives outputsof the detector elements 1504 on detector arrays 1502, digitallyprocesses these outputs and determines whether the absolute amount oflight detected by each of the detector elements 1504 or the change inthe amount of light detected by each of the detector elements 1504exceeds a predetermined threshold. The amount of light detected by theindividual detector elements 1504 on a given detector array 1502, asdetermined by the detector analyzing processing circuitry, is furtherprocessed to provide an array detection output. The array detectionoutput includes information corresponding to the locations ofimpingement points of the user's fingers relative to the given detectorarray 1502. Typically, the locations of at least one detector element1504, in which the amount of light measured or the change in the amountof light measured exceeds a predetermined threshold, correspond to thelocations of the user's fingers along an axis parallel to the givendetector array 1502.

In the configuration shown in FIGS. 20A and 20B, two-dimensionallocation determining circuitry (not shown) preferably calculates thetwo-dimensional position of the impingement points of the user's fingerson or above interactive surface element 1508 by combining the arraydetection outputs of at least two detector arrays, typically arrangedalong at least two mutually perpendicular edges 1506 of interactivesurface element 1508.

As seen in FIGS. 21A and 21B, the user's fingers are located at adistance from one another. In FIG. 2 1A, the user's fingers are locatedin propinquity to interactive surface element 1508, at respectiveheights H1 and H2 therefrom, and in FIG. 21B, the user's fingers touchinteractive surface element 1508. It is appreciated that H1 may be lessthan, equal to or greater than H2.

When the user's fingers touch, as in FIG. 21B, or are located inpropinquity to, as in FIG. 21A, interactive surface element 1508, thelight reflected from the fingers is detected by one or more of detectorelements 1504, as described hereinabove, in addition to the baselinelevel of light detected by the detector elements 1504. Detectoranalyzing processing circuitry (not shown) preferably receives outputsof the detector elements 1504 on detector arrays 1502, digitallyprocesses these outputs and determines whether the absolute amount oflight detected by each of the detector elements 1504 or the change inthe amount of light detected by each of the detector elements 1504exceeds a predetermined threshold.

The amount of light detected by the individual detector elements 1504 ona given detector array 1502, as determined by the detector analyzingprocessing circuitry, is further processed to provide an array detectionoutput. The array detection output includes information corresponding tothe locations of impingement points of the user's fingers relative tothe given detector array 1502. Typically, the locations of at least onedetector element 1504, in which the amount of light measured or thechange in the amount of light measured exceeds a predeterminedthreshold, correspond to the locations of the user's fingers along anaxis parallel to the given detector array 1502.

In the configuration shown in FIGS. 21A and 21B, two-dimensionallocation determining circuitry (not shown) preferably calculates thetwo-dimensional position of the impingement points of the user's fingerson or above interactive surface element 1508 by combining the arraydetection outputs of at least two detector arrays, typically arrangedalong at least two mutually perpendicular edges 1506 of interactivesurface element 1508. As seen in FIG. 22, the user's fingers are locatedat a distance from one another. One of the user's fingers is located inpropinquity to interactive surface element 1508, at a height Htherefrom, and one of the user's fingers touches interactive surfaceelement 1508.

When the user's fingers touch, or are located in propinquity to,interactive surface element 1508, the light reflected from the fingersis detected by one or more of detector elements 1504, as describedhereinabove, in addition to the baseline level of light detected by thedetector elements 1504. Detector analyzing processing circuitry (notshown) preferably receives outputs of the detector elements 1504 ondetector arrays 1502, digitally processes these outputs and determineswhether the absolute amount of light detected by each of the detectorelements 1504 or the change in the amount of light detected by each ofthe detector elements 1504 exceeds a predetermined threshold.

The amount of light detected by the individual detector elements 1504 ona given detector array 1502, as determined by the detector analyzingprocessing circuitry, is further processed to provide an array detectionoutput. The array detection output includes information corresponding tothe locations of impingement points of the user's fingers relative tothe given detector array 1502. Typically, the locations of at least onedetector element 1504, in which the amount of light measured or thechange in the amount of light measured exceeds a predeterminedthreshold, correspond to the locations of the user's fingers along anaxis parallel to the given detector array 1502.

In the configuration shown in FIG. 22, two-dimensional locationdetermining circuitry (not shown) preferably calculates thetwo-dimensional position of the impingement points of the user's fingerson or above interactive surface element 1508 by combining the arraydetection outputs of at least two detector arrays, typically arrangedalong at least two mutually perpendicular edges 1506 of interactivesurface element 1508. Reference is now made to FIGS. 23A-23E, whichillustrate user interface functionality of an interactive assemblyconstructed and operative in accordance with a preferred embodiment ofthe present disclosure. Preferably, the interactive assembly is a mobilecomputer and/or communicator 1600 constructed and operative inaccordance with the teachings of one or more of the followingapplicants'/inventors' patent documents Published PCT PatentApplications: WO 03/104965 A2, WO 2005/094176 A3, WO 2007/029257;International Patent Application Nos. PCT/IL2007/000332 filed Mar. 14,2007; PCT/IL2007/000433 filed Apr. 1, 2007; U.S. Provisional PatentApplication No. 60/715,546, filed Sep. 8, 2005, titled OPTICAL SENSORFOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent ApplicationNo. 60/734,027, filed Nov. 3, 2005, titled CONTROL APPARATUS; U.S.Provisional Patent Application No. 60/789,188, filed Apr. 3, 2006 andtitled USER INTERFACE FUNCTIONALITIES, U.S. Provisional PatentApplication No. 60/682,604, filed May 18, 2005 and titled NOVELDISTORTION LENS; U.S. Provisional Patent Application No. 60/918,303;filed Mar. 14, 2007 and titled INFORMATION INPUT DEVICE and U.S. PatentApplication Publication No. 2005/0156914A1, the disclosures of which arehereby incorporated by reference.

Preferably, the mobile device includes touch responsive inputfunctionality and/or propinquity responsive input functionality providedby at least one interactive surface element 1601, at least a firstregion of the at least one interactive surface element having first usersensible functionality and at least a second region of the at least oneinteractive surface element having second functionality, different fromthe first user sensible functionality, input sensor functionality,including at least one input sensor located in propinquity to a surfaceof the at least one interactive surface element 1601, operative to senseimpingement of an electromagnetic radiation spot on at least one of theat least one first region and the at least one second region of the atleast one interactive surface element and utilization functionality foremploying outputs of the input sensor functionality in respect ofimpingement on either or both of the at least one first region and theat least one second region.

In the illustrated embodiment, the first region may overlie an areahaving display functionality, such as a display screen 1602 and thesecond region may overlie an area having keyboard functionality, such askeyboard 1604, either or both of which regions may have functionality asdescribed hereinabove particularly with reference to FIGS. 20A-22, anduser interface function selection functionality which is responsive toinputs received from the touch responsive input functionality and/orpropinquity responsive input functionality. FIG. 23 A shows a finger1606 located adjacent the first region of the interactive surfaceelement 1601 overlying display screen 1602 and not adjacent the secondregion of the interactive surface element 1601 overlying keyboard 1604.One or preferably both of the first and second regions of theinteractive surface element 1601, as described above, may include touchresponsive input functionality and/or propinquity responsive inputfunctionality.

In the arrangement shown in FIG. 23A, display screen 1602 typicallydisplays an array of application launch icons 1608.

FIG. 23B shows finger 1606 located at a first distance D1 from thesecond region of the interactive surface element 1601 overlying keyboard1604, such that the propinquity responsive input functionality sensesfinger 1606 in propinquity to keyboard 1604 and defines an impingementarea 1609 that is generally centered on a first button 1611, even thoughit may also partially impinge on other buttons. The functionality of themobile device 1600 causes button 1611 to appear in an illuminated orotherwise visually sensibly emphasized form, as indicated by referencenumeral 1612. As seen in FIG. 23B, display screen 1602 typicallydisplays a clear screen.

In accordance with a preferred embodiment of the present disclosure, asshown in FIG. 23C, when finger 1606 is located at a second distance D2from the second region of the interactive surface element 1601 overlyingkeyboard 1604, which may be less than D1, which preferably is selectedas a button actuation threshold distance BAT, the functionality of themobile device 1600 causes a first button actuating event to occur,corresponding to a first function associated with button 1611, such asappearance of a small case letter on display screen 1602, as indicatedby reference numeral 1613.

It is appreciated that various distances of the finger from the secondregion of the interactive surface element 1601 overlying a button onkeyboard 1604 may corresponding to various operational parametersassociated with the function or functions thereof. FIG. 23D shows anexample wherein finger 1606 located at a third distance D3 from thesecond region of the interactive surface element 1601 overlying button1611 on keyboard 1604, which distance may be greater than or less thanor equal to D2, such that the impingement area 1614 of finger 1606 isgenerally centered on button 1611 and extends over only a relativelysmall part of the area of the button. The functionality of the mobiledevice 1600 causes a second button actuating event to occur,corresponding to a second function associated with button 1611, such asthe appearance of a large case letter on display screen 1602, asindicated by reference numeral 1615.

It is appreciated that the functionalities illustrated in some but notall of FIGS. 23A, 23B, 23C and 23D may be obviated in a system which isdifferentially responsive to touch and propinquity, but does notdistinguish between degrees of propinquity within a given threshold.

In accordance with a preferred embodiment of the present disclosure, asshown in FIG. 23E, when the finger 1606 touches the second region of theinteractive surface element 1601 overlying button 1611 of keyboard 1604,a third function is actuated, such as the appearance of a number ondisplay screen 1602, as indicated by reference numeral 1616. Actuationof any one or more of the functions is preferably may be accompanied byfeedback to the user, such as visual, auditory or tactile feedback,interactive surface element.

It is appreciated that, as shown in the above example, a single fingermovement from D1 to D3 can replace multiple touch engagements requiredby prior art devices.

It is appreciated that the functionality of FIGS. 23A-23E may beprovided and/or used alone or in combination with any other suitablefunctionality, such as any one or more of the other functionalitiesdescribed herein below with reference to FIGS. 24A-26D.

Reference is now made to FIGS. 24A and 24B, which illustrate userinterface functionality of an interactive assembly constructed andoperative in accordance with a preferred embodiment of the presentdisclosure. Preferably, the interactive assembly is a mobile computerand/or communicator 1700 constructed and operative in accordance withthe teachings of one or more of the following applicants'/inventors'patent documents: Published PCT Patent Applications: WO 03/104965A2, WO2005/094176A3, WO 2007/029257; International Patent Application Nos.PCT/IL2007/000332 filed Mar. 14, 2007; PCT/IL2007/000433 filed Apr. 1,2007; U.S. Provisional Patent Application No. 60/715,546, filed Sep. 8,2005, titled OPTICAL SENSOR FOR MEASUREMENT OF L1GHT SCATTERING; U.S.Provisional Patent Application No. 60/734,027, filed Nov. 3, 2005,titled CONTROL APPARATUS; U.S. Provisional Patent Application No.60/789,188, filed Apr. 3, 2006 and titled USER INTERFACEFUNCTIONALITIES, U.S. Provisional Patent Application No. 60/682,604,filed May 18, 2005 and entitled NOVEL DISTORTION LENS; U.S. ProvisionalPatent Application No. 60/918,303; filed Mar. 14, 2007 and titledINFORMATION INPUT DEVICE and U.S. Patent Application Publication No.2005/0156914A1, the disclosures of which are hereby incorporated byreference.

Preferably, the mobile device includes touch responsive inputfunctionality and/or propinquity responsive input functionality providedby at least one interactive surface element, at least a first region ofthe at least one interactive surface element having first user sensiblefunctionality and at least a second region of the at least oneinteractive surface element having second functionality, different fromthe first user sensible functionality, input sensor functionality,including at least one input sensor located in propinquity to a surfaceof the at least one interactive surface element, operative to senseimpingement of an electromagnetic radiation spot on at least one of theat least one first region and the at least one second region of the atleast one interactive surface element and utilization functionality foremploying outputs of the input sensor functionality in respect ofimpingement on either or both of the at least one first region and theat least one second region.

In the illustrated embodiment, the at least one interactive surfaceelement includes two interactive surface elements 1702 and 1704. Thefirst region may overlie an area having display functionality, such as adisplay screen 1706, overlying interactive surface element 1702, and thesecond region may overlie an area having slider control functionality,such as slider 1708, overlying interactive surface element 1704, eitheror both of which regions may have functionality as described hereinaboveparticularly with reference to FIGS. 20A-22, and user interface functionselection functionality which is responsive to inputs received from thetouch responsive input functionality and/or propinquity responsive inputfunctionality. FIG. 24A shows a finger 1710 located adjacent a firstlocation in the second region of the interactive surface element 1704overlying slider 1708 and not adjacent the first region of theinteractive surface element 1702 overlying display screen 1706. One orpreferably both of the first and second regions of the interactivesurface elements 1702 and 1704, as described above, may include touchresponsive input functionality and/or propinquity responsive inputfunctionality.

In the arrangement shown in FIG. 24A, display screen 1706 typicallydisplays a volume level indication.

FIG. 24B shows finger 1710 located at a second location in the secondregion of the interactive surface element 1704 overlying slider 1708,such that the propinquity responsive input functionality senses thelocation of finger 1710 in propinquity to slider 1708 and defines animpingement area 1720 that is generally centered on a location of theslider 1708, even though it may also partially impinge on other portionsof the slider 1708. The functionality of the mobile device 1700 maycause various locations on the slider 1708 to appear in an illuminatedor otherwise visually sensibly emphasized form, as indicated byreference numeral 1722. Alternatively, the functionality of the mobiledevice 1700 may provide slider actuation feedback on display screen 1706or in any other manner, such as by providing an auditory response.

It is appreciated that various distances of the finger from the secondregion of the interactive surface element 1704 overlying slider 1708 maycorrespond to various operational parameters associated with thefunction or functions thereof. For example, if the finger 1710 touchesthe slider 1708, the slider may have a display contrast controlfunctionality, while if the finger 1710 is within predeterminednon-touching propinquity with the slider, it may have volume controlfunctionality, as illustrated.

It is appreciated that, as shown in the above example, a single fingermovement can replace multiple touch engagements required by prior artdevices. It is appreciated that the functionality of FIGS. 24A and 24Bmay be provided and/or used alone or in combination with any othersuitable functionality, such as any one or more of the otherfunctionalities described hereinabove and herein below with reference toFIGS. 23A-23E and 25A-26D.

Reference is now made to FIGS. 25A and 25B, which illustrate userinterface functionality of an interactive assembly constructed andoperative in accordance with a preferred embodiment of the presentdisclosure. Preferably the interactive assembly is a mobile computerand/or communicator 1800 constructed and operative in accordance withthe teachings of one or more of the following applicants'/inventors'patent documents: Published PCT Patent Applications: WO 03/104965A2, WO2005/094176A3, WO 2007/029257; International Patent Application Nos.PCT/IL2007/000332 filed Mar. 14, 2007; PCT/IL2007/000433 filed Apr. 1,2007; U.S. Provisional Patent Application No. 60/715,546, filed Sep. 8,2005, titled OPTICAL SENSOR FOR MEASUREMENT OF L1GHT SCATTERING; U.S.Provisional Patent Application No. 60/734,027, filed Nov. 3, 2005,titled CONTROL APPARATUS; U.S. Provisional Patent Application No.60/789,188, filed Apr. 3, 2006 and titled USER INTERFACEFUNCTIONALITIES, U.S. Provisional Patent Application No. 60/682,604,filed May 18, 2005 and titled NOVEL DISTORTION LENS; U.S. ProvisionalPatent Application No. 60/918,303; filed Mar. 14, 2007 and titledINFORMATION INPUT DEVICE and U.S. Patent Application Publication No.2005/0156914A1, the disclosures of which are hereby incorporated byreference.

Preferably the mobile device includes touch responsive inputfunctionality and/or propinquity responsive input functionality providedby at least one interactive surface element 1802, at least a firstregion of the at least one interactive surface element having first usersensible functionality and at least a second region of the at least oneinteractive surface element having second functionality, different fromthe first user sensible functionality, input sensor functionality,including at least one input sensor located in propinquity to a surfaceof the at least one interactive surface element 1802, operative to senseimpingement of an electromagnetic radiation spot on at least one of theat least one first region and the at least one second region of the atleast one interactive surface element and utilization functionality foremploying outputs of the input sensor functionality in respect ofimpingement on either or both of the at least one first region and theat least one second region.

In the illustrated embodiment, the first region may overlie an areahaving display functionality, such as a display screen 1804 and thesecond region may overlie a margin area having slider controlfunctionality, such as slider 1805, either or both of which regions mayhave functionality as described hereinabove particularly with referenceto FIGS. 20A-22, and user interface function selection functionalitywhich is responsive to inputs received from the touch responsive inputfunctionality and/or propinquity responsive input functionality.

FIG. 25A shows a finger 1806 located adjacent to and overlying a firstlocation in the second region of the interactive surface element 1802 atslider 1805 and spaced therefrom by a first distance D1 which may begreater than or equal to zero. One or preferably both of the first andsecond regions of the interactive surface element 1802, as describedabove, may include touch responsive input functionality and/orpropinquity responsive input functionality. In the arrangement shown inFIG. 25A, display screen 1804 typically displays a scrollable list. Thedistance by which the finger 1806 is spaced from the slider 1805controls the scrolling speed.

FIG. 25B shows finger 1806 located at a second location in the secondregion of the interactive surface element 1802 overlying slider 1805,such that the propinquity responsive input functionality senses thelocation of finger 1806 in propinquity to slider 1805 and defines animpingement area 1810 that is generally centered on a location of theslider 1805, even though it may also partially impinge on other portionsof the slider 1805. Here the finger is located at a second distance D2,which is greater than D1, from the slider 1805, which provides a fasterscrolling speed than when the finger is closer to the slider 1805, as inFIG. 25A.

It is appreciated that, as shown in the above example, a single fingermovement can replace multiple touch engagements required by prior artdevices.

It is appreciated that the functionality of FIGS. 25A and 25B may beprovided and/or used alone or in combination with any other suitablefunctionality, such as any one or more of the other functionalitiesdescribed hereinabove and herein below with reference to FIGS. 23A-24Band 26A-26D. Reference is now made to FIGS. 26A-26D, which illustrateuser interface functionality of an interactive assembly constructed andoperative in accordance with a preferred embodiment of the presentdisclosure. Preferably the interactive assembly is a mobile computerand/or communicator 1900 constructed and operative in accordance withthe teachings of one or more of the following applicants'/inventors'patent documents: Published PCT Patent Applications: WO 03/104965A2, WO2005/094176A3, WO 2007/029257; International Patent Application Nos.PCT/IL2007/000332 filed Mar. 14, 2007; PCT/IL2007/000433 filed Apr. 1,2007; U.S. Provisional Patent Application No. 60/715,546, filed Sep. 8,2005, titled OPTICAL SENSOR FOR MEASUREMENT OF L1GHT SCATTERING; U.S.Provisional Patent Application No. 60/734,027, filed Nov. 3, 2005,titled CONTROL APPARATUS; U.S. Provisional Patent Application No.60/789,188, filed Apr. 3, 2006 and titled USER INTERFACEFUNCTIONALITIES, U.S. Provisional Patent Application No. 60/682,604,filed May 18, 2005 and titled NOVEL DISTORTION LENS; U.S. ProvisionalPatent Application No. 60/918,303; filed Mar. 14, 2007 and titledINFORMATION INPUT DEVICE; and U.S. Patent Application Publication No.2005/0156914A1, the disclosures of which are hereby incorporated byreference.

Preferably the mobile device includes touch responsive inputfunctionality and/or propinquity responsive input functionality providedby at least one interactive surface element 1901, at least a firstregion of the at least one interactive surface element having first usersensible functionality and at least a second region of the at least oneinteractive surface element having second functionality, different fromthe first user sensible functionality, input sensor functionality,including at least one input sensor located in propinquity to a surfaceof the at least one interactive surface element 1901, operative to senseimpingement of an electromagnetic radiation spot on at least one of theat least one first region and the at least one second region of the atleast one interactive surface element and utilization functionality foremploying outputs of the input sensor functionality in respect ofimpingement on either or both of the at least one first region and theat least one second region.

In the illustrated embodiment, the first region may overlie an areahaving display functionality, such as a display screen 1902 and thesecond region may overlie a keyboard area having ringer controlfunctionality, such as keyboard zone 1904, either or both of whichregions may have functionality as described hereinabove particularlywith reference to FIGS. 20A-22, and user interface function selectionfunctionality which is responsive to inputs received from the touchresponsive input functionality and/or propinquity responsive inputfunctionality. FIG. 26A shows a hand 1906 overlying the second region ofthe interactive surface element 1901 at keyboard zone 1904 and spacedtherefrom by a first distance D1. One or preferably both of the firstand second regions of the interactive surface element 1901, as describedabove, may include touch responsive input functionality and/orpropinquity responsive input functionality. In the arrangement shown inFIG. 26A, the functionality of the second region governs the ringingvolume of the communicator 1900 and the position of the hand 1906 shownin FIG. 26A and its degree of propinquity to the keyboard zone 1904causes a reduction in the ringing volume.

FIG. 26B shows hand 1906 located at a second distance D2, less than D1,from the keyboard zone 1904, which causes a further reduction in theringing volume of the communicator.

FIG. 26C shows hand 1906 located at a third distance D3, less than D2and typically zero from the keyboard zone 1904, which causes muting ofthe ringing of the communicator and actuation of call divertfunctionality. FIG. 26D shows hand 1906 still located at third distanceD3, from the keyboard zone 1904, and the provision of visual feedback inthe form of a visible alert on display screen 1902 indicating muting ofthe ringing of the communicator and diversion of the call.

It is appreciated that, as shown in the above example, a gesture canreplace multiple touch engagements required by prior art devices.

It is appreciated that the functionality of FIGS. 26A-26D may beprovided and/or used alone or in combination with any other suitablefunctionality, such as any one or more of the other functionalitiesdescribed herein below with reference to FIGS. 23A-25B.

The array detection output is constructed on the basis of outputs of theindividual detector in the array, taking into account the relativepositions of the individual detectors. One or more array detectionoutputs represent the shape, size, location and/or intensity of a lightspot defined by the impingement of light on the interactive surface or alayer thereof.

By measuring, comparing, combining and/or contrasting data points,variables, and characteristics represented or indicated by one or morearray detection outputs, meaningful and useful information about thelight spot may be obtained. This information may include: x and ycoordinates of the center of the light spot and any one or more of size,shape, symmetry, eccentricity, intensity and/or orientation of the lightspot relative to the interactive surface and detector arrays associatedtherewith.

Utilization functionality, preferably embodied in utilization circuitry,may utilize such light spot information. The utilization functionalitymay utilize data taken directly from raw data output by the detectorarrays, or alternatively may further process the raw data by applicationthereto of one or more smoothing algorithms. As a further alternative,one or more curve-fitting algorithms may be applied to the raw data orto smoothed data. Examples of curve fitting algorithms include paraboliccurve-fitting algorithms, polynomial curve-fitting algorithms, andGaussian curve-fitting algorithms.

Examples of derivation of light spot information from raw data, smootheddata or curve-fitted data include:

1. The peak of curve-fitted data derived from a single detector arraycorresponds to the center of the light spot along an axis Y generallyparallel to the detector array. The height of the peak of thecurve-fitted data generally is a function of the distance of the centerof the light spot from the closed individual detectors in the detectorarray along an axis X, generally perpendicular to the detector array.

It is appreciated that combining and comparing data from two or moredetector arrays allows for calculation of Y and X axis positionalcoordinates of the center of the light spot by finding the curve peakfor each detector array output, rather than solely on the basis of theheight of the curve peak. This provides multiple advantages, it beingappreciated that utilizing two or more detector arrays located alongdifferent edges of the interactive surface tends to provide morecomplete and stronger signal data than utilizing a single array.

Additionally, where the location of a curve peak derived from a seconddetector array output is used to find the X coordinate, data relating tothe height of at least one peak derived from at least one detector arrayoutput may be utilized to supplement, correct, adjust and/or confirmdata relating to the X and Y coordinates, the size of the light spot,and/or other relevant data.

2. The width of a curve fitted to the raw or smoothed data, for example,as indicated by Sigma of a Gaussian-fitted curve, correlates generallyto the size of the light spot along an axis generally parallel to thecorresponding detector array. The size of the light spot is a functionat least of the distance S of the origin of the light spot from theinteractive surface, as measured along a straight line connecting theorigin on an input object and the center of the light spot on theinteractive surface. It is thus appreciated that the smaller thedistance S, the smaller the light spot impinging on the interactivesurface and conversely, the larger the distance S, the larger the lightspot.

The height of the peak of the curve generally correlates with theintensity of the light spot, which in turn correlates also with thedistance S.

It is appreciated that the height of the peak of the curve alsocorrelates with the distance of the center of the light spot from thecorresponding detector array along axis X, generally perpendicular tothe detector array.

3. Data related to both the width of the curve and the peak of thecurve, taken in combination, provide enhanced accuracy and robustness tocalculations of the distance S. The widths of curves derived fromdetector array outputs of two or more detector arrays can be employed toenable calculation of major and minor axes of a generally ellipticallight spot formed by impingement of the light from an input object uponthe interactive surface.

By comparing the widths and asymmetries of non-Gaussian curves derivedfrom detector array outputs of two or more detector arrays, theorientation and degree of eccentricity of a light spot may be derived.The degree of eccentricity correlates with the angle of elevation of theinput object, which may be defined as the angle between a line whosedistance is S and the plane of the interactive surface. The orientationof the light spot correlates to the rotational orientation of the inputobject about a center point defined by the X, Y coordinates of thecenter of the light spot.

4. Orientation of the light spot with respect to one or more detectorarrays may be derived as follows: The steepness of the slopes of asmoothed or fitted curve of a detector array output correlate with thedimension of the light spot along an axis generally parallel to thedetector array. When the orientation of the light spot is such thateither a major or minor axis of the light spot is generally aligned inparallel to the detector array, the left and right slopes (Slope L andSlope R) of the smoothed or fitted curve will be generally equal.

When, however, the major and minor axes are not aligned in parallel tothe detector array, Slope L and Slope R will differ from one another.Typically, a slope corresponding to the side of the light spot orientednearest to the detector array will be greater. The relationship of SlopeL and Slope R correlates to the orientation of the light spot on theinteractive surface, and hence to the rotational orientation of theinput object about a center point defined by the X, Y coordinates of thecenter of the light spot.

5. The difference in intensity of different portions of the light spotnearer and further from at least one detector array may be employed toresolve a mirror ambiguity in the rotational orientation of the inputobject. The light spot will have a “brighter” or more intenselysignal-generating portion, which corresponds to the portion of the lightbeam which is nearer the interactive surface and hence travels less farand disperses less than the other portion of the light beam, which isfurther from the interactive surface and thus travels further.

The extent of difference in intensity is correlated to the angle ofelevation of the input object. The steepness of Slope L and Slope R of asmoothed or fitted curve of a detector array output correlate with thedimension of the light spot along an axis generally parallel to thedetector array. Comparing Slope L and Slope R of a smoothed or fittedcurve of a first detector array with Slope L and Slope R of a smoothedor fitted curve of a second detector array provides an alternativemethod for calculating eccentricity of the light spot and thus providesan alternative method for calculating the angle of elevation of theinput object relative to the interactive surface.

Thus, calculating Slope L and Slope R for multiple detector arraysprovides elevation data for the input object, while comparing Slope Land Slope R of a given detector array provides information about theextent of rotation of the input object about a center point defined bythe X, Y coordinates of the center of the light spot. Comparing Slope Land Slope R of a given detector array also provides a method fordistinguishing between the reflective symmetries of the rotation dataset.

Calculating and comparing Slope L and Slope R for multiple detectorarrays may be used to enhance the accuracy and robustness of angle andorientation data for an input object. It is appreciated that most or allrequired information about the light spot and the location of the inputobject relative to the interactive surface may be derived from theoutput of a single detector array, and that this may be advantageous inmany contexts. It is further appreciated that while all such informationmay be derived from the output of a single detector array, it is oftenadvantageous to utilize outputs from at least two detector arrays. Thenumber of detector arrays implemented and utilized in a given product isdetermined by various considerations, for example, including: cost, sizeof the interactive surface, expected strength of the light source, powerconsumption requirements and the desired range of input distances.

It is further appreciated that the utilization and calculation methodsdescribed herein apply to an interactive input assembly which is sensinglight reflected by a input object (for example, as illustrated in FIGS.1A and 1B), to an interactive input assembly which is sensing lightemitted by the input object (for example, as shown in FIG. 1C), and alsoto an interactive input assembly operative to sense both light reflectedfrom an input object and light emitted from the same input object or adifferent input object. It is further appreciated that essentially thesame methods are applicable to forward-facing or forward-angled sensors,as those shown in FIGS. 1E and 1F.

In all of these cases, the scales of values of intensity of individualdetector outputs may differ, even substantially, but the essentialcharacteristics of the light spot, such as x and y coordinates of thecenter of the light spot and any one or more of size, shape, symmetry,eccentricity, intensity and/or orientation of the light spot relative tothe interactive surface and detector arrays associated therewith maystill be derived from the raw data output by the detector arraysaccording to the same principles and relationships described above.

These characteristics of the light spot, and the ability to use the samephysical assembly and/or same processing circuitry to processinformation about the location of various input objects whether theyemit or reflect light, is particularly advantageous for products inwhich multiple input modes are to be provided, such as the assemblyillustrated in FIG. 1F, where input to the mobile device and input tothe large screen device may be both processed by a single processingcircuitry located in the mobile device or elsewhere. Another example ofutilization of multiple input modes is a mobile device such as thoseshown in FIG. 1A and FIG. 1C, where it may be desirable to provide bothfinger touch input and light-emitting stylus input for differentfunctions, for example, finger touch input for application selectionfunctionality, and light-emitting stylus input for gaming functionality.It is noted that when processing detector array data from an assembly,such as those illustrated in FIGS. 1C-1D and 2A-3B, where the detectorsare arranged in a plane generally parallel to the plane of theinteractive surface, some portion of the calculating process describedabove may be obviated, for example, the stages in which circuitrysmoothes raw data, fits a curve to the measured output, and/orcorrelates a data curve with the location of the light spot.

In such a case, the utilization circuitry may preferentially interpretraw data from detector outputs as a shape and correlate that shapedirectly to the light spot whose edges are defined by a pre-determinedoutput signal threshold. Additionally or alternatively, a smoothingand/or shape-fitting algorithm may be employed. The X and Y positionalcoordinates of the center of the light spot correlate with theintersection of axes bisecting the shape, the S distance correlates withthe total area of the shape, and the elevation and rotation anglescorrelate with measured asymmetries of the shape. Mirror ambiguities inrotational orientation may be resolved by identifying the side of thelight pattern generating the strongest signal, which correlates with thenearer portion of the emitted or reflected light beam, as describedabove.

It is appreciated that, if desired, a height Z, defined as the distanceof the light emitting or reflecting input object from the plane of theinteractive surface along a line drawn perpendicular to the interactivesurface, may be easily found by geometric Pythagorean triangulation,where the plane of the interactive surface represents the base of aright triangle, and the S distance represents the hypotenuse of thetriangle, which hypotenuse meets the base forming an angle equal to thatdefined by the angle of elevation or tilt described above.

It is further appreciated that it may desirable to limit the S distancedata coordinate outputs to three states: Off (representing no fingerdetected within the predetermined threshold range), Hover (representinga finger detected within the threshold range but not touching theinteractive surface), and Touch (representing a state in which thefinger is detected at the level of the interactive surface). For the twolatter states (Hover and Touch), X and Y position coordinates relativeto the interactive surface are preferably provided by the utilizationcircuitry as described above.

Limitation of S distance data coordinate outputs to three states may bedesirable for usability reasons, or where some of the parametersdescribed hereinabove are difficult to calculate with a desirable levelof accuracy, for example, because of signal strength or the specificdesign of the interactive input assembly and its associated device. Insuch a case, the calculations used to calculate such parameter orparameters may be omitted, additional arrays of detectors may beimplemented, or a reduced resolution of coordinate data may be provided.It is appreciated by persons skilled in the art that the presentdisclosure is not limited by what has been particularly shown anddescribed hereinabove. Rather the scope of the present disclosureincludes both combinations and sub-combinations of various featuresdescribed hereinabove as well as variations and modifications theretowhich would occur to a person of skill in the art upon reading the abovedescription and which are not in the prior art.

What is claimed is:
 1. An interactive device comprising: a housing; adisplay disposed in the housing and defining a viewing plane, thedisplay is configured to convey a digital image to a user; a lighttransmissive element forming a cover layer proximate to the display; anemitter disposed in the housing, the emitter radiating light forreflection by a stylus in proximity of the interactive device; an arrayof detectors disposed in the housing and positioned proximate to thelight transmissive element, the array of detectors includes one or moredetectors configured to detect at least a portion of light reflected bythe stylus and transmitted through the light transmissive element,wherein the portion of light reflected by the stylus includes lightemitted by the stylus; and a processor disposed in the housing, theprocessor is configured to: receive an output corresponding to theportion of light detected by the one or more detectors; determine aradiation pattern corresponding to the portion of light incident on thelight transmissive element, the radiation pattern defining at least oneof a shape or a size; determine a position of the stylus relative to atleast a portion of the interactive device based on the radiationpattern; determine the position of the stylus corresponds to an input;and execute a function based on the input.
 2. The interactive device ofclaim 1, wherein the processor is further configured to: determine theoutput from the one or more detectors corresponds to a change in lightintensity; and execute the function when the change in the lightintensity exceeds a predetermined threshold.
 3. The interactive deviceof claim 1, wherein the digital image includes one or more graphicalelements, wherein the processor is further configured to: identify afirst graphical element of the one or more graphical elements based onthe position of the stylus; and execute a function associated with thefirst graphical element.
 4. The interactive device of claim 1, whereinthe array of detectors comprises a first array of detectors and a secondarray of detectors, wherein the first array of detectors is arrangedsubstantially perpendicular to the second array of detectors.
 5. Theinteractive device of claim 1, wherein the array of detectors furthercomprises a first array of detectors configured to detect light on afirst axis and a second array of detectors configured to detect light ona second axis, wherein the processor is further configured to: determinethe position of the stylus corresponds to a two-dimensional coordinateon the first axis and the second axis based on the output.
 6. Theinteractive device of claim 1, wherein the stylus includes a firstobject and a second object, wherein the processor is further configuredto: determine a first position of the first object and a second positionof a second object based on the output.
 7. The interactive device ofclaim 1, wherein the processor is further configured to determine, basedon the output, a three-dimensional position of the stylus relative to atleast a portion of the interactive device.
 8. The interactive device ofclaim 1, further comprising: an backlight illumination source disposedin the housing, the backlight illumination source including the emitter.9. The interactive device of claim 1, wherein the emitter is configuredto emit infrared (IR) light.
 10. The interactive device of claim 1,wherein the function includes to at least one of a selection function, ascroll function, or a zoom function.
 11. An interactive devicecomprising: a housing; a light transmissive element forming a coverlayer proximate to a top portion of the housing; an emitter disposed ina housing, the emitter radiating light for reflection by an object inproximity to the interactive device; one or more detectors disposed in ahousing and positioned proximate to a display configured to show one ormore digital graphical elements, the one or more detectors forming adetection plane proximate to the light transmissive element, whereineach detector is configured to detect at least a portion of lightreflected by the object and transmitted through the light transmissiveelement; and a processor configured to: receive an output correspondingto the portion of light detected by at least one detector; determine aradiation pattern corresponding to the portion incident on the lighttransmissive element, the radiation pattern defining at least one of ashape or a size; determine the radiation pattern corresponds to an inputrelative to at least one of the one or more digital graphical elementsbased on a change in the portion of light detected by the at least onedetector; and execute a function corresponding to the at least one ofthe one or more digital graphical elements based on the input.
 12. Theinteractive device of claim 11, wherein the function corresponds to atleast one of a selection function, a scroll function, or a zoomfunction.
 13. The interactive device of claim 11, wherein the processoris further configured to: determine, based on the radiation pattern, athree-dimensional position of the object relative to at least a portionof the interactive device; and determine the three-dimensional positionof the object corresponds to a hover input.
 14. The interactive deviceof claim 11, wherein the processor is further configured to: determinean impingement area associated with the display corresponds to theradiation pattern based on the output from the at least one detector;and determine the function based on the impingement area.
 15. Theinteractive device of claim 14, wherein the function includes aselection of one of the digital graphical elements.
 16. The interactivedevice of claim 11, wherein the emitter is configured to radiateinfrared (IR) light.
 17. The interactive device of claim 11, wherein theobject includes at least one of a stylus or a finger.
 18. A method forinteracting with a device, the method comprising: displaying, by adisplay disposed in a housing of the mobile device, a digital image to auser; radiating, by an emitter disposed in the housing, light forreflection by an object in proximity to the mobile device; detecting, byan array of detectors disposed in the housing, at least a portion oflight reflected by the object and transmitted through a lighttransmissive element, wherein the light transmissive element forms acover layer proximate to the display, wherein the portion of lightreflected by the object includes light emitted by the object; receiving,by processing circuitry disposed in the housing, an output correspondingto the portion of light detected by the array of detectors; determining,by the processing circuitry, a radiation pattern for the portion oflight detected by the one or more detectors, the radiation patterndefining at least one of a shape or a size of light incident on thelight transmissive element; determining, by the processing circuitry, aposition of the object relative to at least a portion of the interactivedevice based on the radiation pattern; determining the position of theobject corresponds to an input; and executing, by the processingcircuitry, a function based on the input.